Benchmark explainer
What is FrontierMath Tiers 1–3?
Research-level novel math, far beyond competition
FrontierMath (private v2, tiers 1-3) — original, unpublished research-level mathematics problems commissioned by Epoch AI to resist memorization and contamination; scored as accuracy (%). The private held-out set keeps the test set uncontaminated.
How it's scored
- Metric
- Exact-match auto-verified (SymPy/numeric)
- Score ceiling
- 100
- Construction
- 60+ mathematicians; v2 ~338 Tier1-3 + Tier4; auto-checkable answers
- Human baseline
- No human solves the set; hours-days per problem
How trustworthy
Discrimination
100/100Does it still separate models?
Saturation headroom
97.8/100How far from ceiling / clustered at the top?
Contamination resistance
100/100Public vs held-out; training-leak risk.
Harness comparability
100/100Is it apples-to-apples, or mixed / vendor-optimized?
Freshness
100/100How old is the benchmark?
Contamination history: OpenAI (funder) had access to ~28/48 Tier-4 under verbal no-train; undisclosed funding scandal 2025
Limitations: Excludes proofs; tiny; correct answer can hide invalid method; access controversy
Who leads FrontierMath Tiers 1–3
| Model | Score | Evidence |
|---|---|---|
| GPT-6.1 Sol | 93.68 | unverified |
| GPT-6 Astra | 93.68 | unverified |
| Claude Opus 5.5 | 91.23 | unverified |
| Claude Fable 5.1 | 90.18 | unverified |
| GPT-6 Sol | 89.82 | unverified |
Compare the top FrontierMath Tiers 1–3 scorers
Frequently asked questions
FrontierMath-Tiers-1-3-v2-Private (FrontierMath): FrontierMath (private v2, tiers 1-3) — original, unpublished research-level mathematics problems commissioned by Epoch AI to resist memorization and contamination; scored as accuracy (%). The private held-out set keeps the test set uncontaminated.
GPT-6.1 Sol leads FrontierMath-Tiers-1-3-v2-Private at 93.68. The full leaderboard above lists every recorded measurement, not just the headline number.
84 models have recorded scores on FrontierMath-Tiers-1-3-v2-Private, spanning a score spread of 93.68.
tensor.news grades FrontierMath-Tiers-1-3-v2-Private A for integrity (score 99/100), ranking #3 of 65 benchmarks we assess across discrimination, saturation, contamination resistance, harness comparability, and freshness.
No — FrontierMath-Tiers-1-3-v2-Private still has headroom and continues to discriminate between models rather than bunching them at the ceiling.
Its test set is held-out, which lowers — but does not eliminate — the risk that training data leaked into the questions.
Scores are reported under a consistent harness, so comparisons on FrontierMath-Tiers-1-3-v2-Private are reasonably apples-to-apples.
Every FrontierMath-Tiers-1-3-v2-Private measurement is source-backed and tagged reproduced, self-reported, or unverified; the underlying record cites epoch.ai/frontiermath.