MATH (competition mathematics)
Rank #39 of 51 · 78 models scored · top score 98.13
Competition math; L5=hardest band
Strongest on discrimination, weakest on contamination resistance. Caveat: the public test set leaves contamination on the table.
Weighted composite. Each signal is computed from the source-backed leaderboard below.
Does it still separate models?
How far from ceiling / clustered at the top?
Public vs held-out; training-leak risk.
Apples-to-apples, or mixed / vendor-optimized?
How old is the benchmark?
| # | Model | Score | Evidence | Measured |
|---|---|---|---|---|
| 1 | GPT-5 | 98.13 | reproduced· optimized | 2025-08-07 |
| 2 | GPT-5 mini | 97.85 | reproduced· optimized | 2025-08-07 |
| 3 | o4-mini | 97.83 | reproduced· optimized | 2025-04-16 |
| 4 | o3 | 97.77 | reproduced· optimized | 2024-12-20 |
| 5 | Claude Sonnet 4.5 | 97.73 | reproduced· optimized | 2025-09-29 |
| 6 | Qwen3-Max | 97.13 | reproduced· optimized | 2025-09-05 |
| 7 | DeepSeek-R1 (May 2025) | 96.64 | reproduced· optimized | 2025-05-28 |
| 8 | o3-mini | 96.49 | reproduced· optimized | 2025-01-31 |
| 9 | Claude Haiku 4.5 | 96.36 | reproduced· optimized | 2025-10-15 |
| 10 | Gemini 2.5 Pro (May 2025) | 95.9 | reproduced· optimized | 2025-05-06 |
| 11 | Gemini 2.5 Pro (Mar 2025) | 95.56 | reproduced· optimized | 2025-03-25 |
| 12 | GPT-5 nano | 95.24 | reproduced· optimized | 2025-08-07 |
| 13 | o1 | 94.71 | reproduced· optimized | 2024-12-05 |
| 14 | DeepSeek-R1 | 93.05 | reproduced· optimized | 2025-01-20 |
| 15 | Claude 3.7 Sonnet | 91.16 | reproduced· optimized | 2025-02-24 |
| 16 | Grok-3 mini | 90.94 | reproduced· optimized | 2025-02-19 |
| 17 | o1-mini | 89.18 | reproduced· optimized | 2024-09-12 |
| 18 | Grok 3 | 88.75 | reproduced· optimized | 2025-02-17 |
| 19 | GPT-4.1 mini | 87.29 | reproduced· optimized | 2025-04-14 |
| 20 | Claude Opus 4 | 85.05 | reproduced· optimized | 2025-05-22 |
| 21 | Claude Sonnet 4 | 84.37 | reproduced· optimized | 2025-05-22 |
| 22 | Gemini 2.0 Pro | 83.46 | reproduced· optimized | 2024-12-11 |
| 23 | GPT-4.1 | 83.01 | reproduced· optimized | 2025-04-14 |
| 24 | Gemini 2.0 Flash (Feb 2025) | 82.17 | reproduced· optimized | 2024-12-11 |
| 25 | o1-preview | 81.65 | reproduced· optimized | 2024-09-12 |
| 26 | Mistral Medium 3 | 81.63 | reproduced· optimized | 2025-05-07 |
| 27 | GPT-4.5 | 78.63 | reproduced· optimized | 2025-02-27 |
| 28 | DeepSeek-V3 (Mar 2025) | 75.55 | reproduced· optimized | 2025-03-24 |
| 29 | Gemma 3 27B | 74.04 | reproduced· optimized | 2025-03-12 |
| 30 | Llama 4 Maverick | 73.02 | reproduced· optimized | 2025-04-05 |
| 31 | Gemini 1.5 Pro (Sept 2024) | 70.39 | reproduced· optimized | 2024-09-24 |
| 32 | GPT-4.1 nano | 70 | reproduced· optimized | 2025-04-14 |
| 33 | Qwen3-235B-A22B | 68.86 | reproduced· optimized | 2025-04-28 |
| 34 | Qwen2.5-Max | 67.18 | reproduced· optimized | 2025-01-25 |
| 35 | Phi-4 | 64.94 | reproduced· optimized | 2024-12-12 |
| 36 | DeepSeek-V3 | 64.85 | reproduced· optimized | 2024-12-24 |
| 37 | Grok-2 (Dec 2024) | 63.52 | reproduced· optimized | 2024-08-13 |
| 38 | Qwen2.5-72B | 63.17 | reproduced· optimized | 2024-09-19 |
| 39 | Llama 4 Scout | 62.27 | reproduced· optimized | 2025-04-05 |
| 40 | Gemini 1.5 Flash (Sep 2024) | 61.87 | reproduced· optimized | 2024-05-10 |
| 41 | Claude 3.5 Sonnet (October 2024) | 56.95 | reproduced· optimized | 2024-10-22 |
| 42 | GPT-4o (Aug 2024) | 53.28 | reproduced· optimized | 2024-05-13 |
| 43 | GPT-4o mini | 52.63 | reproduced· optimized | 2024-07-18 |
| 44 | Claude 3.5 Sonnet | 51.68 | reproduced· optimized | 2024-06-20 |
| 45 | GPT-4o (May 2024) | 51.05 | reproduced· optimized | 2024-05-13 |
| 46 | Mistral Large 2 (Nov 2024) | 50.28 | reproduced· optimized | 2024-07-24 |
| 47 | Llama 3.1-405B | 49.77 | reproduced· optimized | 2024-07-23 |
| 48 | GPT-4o (Nov 2024) | 49.77 | reproduced· optimized | 2024-05-13 |
| 49 | Mistral Small 3.1 | 46.77 | reproduced· optimized | 2025-03-17 |
| 50 | GPT-4 Turbo (Apr 2024) | 46.73 | reproduced· optimized | 2024-04-09 |
| 51 | Claude 3.5 Haiku | 46.36 | reproduced· optimized | 2024-10-22 |
| 52 | Mistral Large 2 (Jul 2024) | 44.82 | reproduced· optimized | 2024-07-24 |
| 53 | Llama 3.3 70B | 41.6 | reproduced· optimized | 2024-12-06 |
| 54 | Gemini 1.5 Pro (May 2024) | 40.75 | reproduced· optimized | 2024-05-14 |
| 55 | Llama 3.2 90B | 39.44 | reproduced· optimized | 2024-09-24 |
| 56 | Qwen2-72B | 39.07 | reproduced· optimized | 2024-06-07 |
| 57 | Claude 3 Opus | 37.48 | reproduced· optimized | 2024-03-04 |
| 58 | Llama 3.1-70B | 36.68 | reproduced· optimized | 2024-07-23 |
| 59 | Gemma 2 27B | 27.89 | reproduced· optimized | 2024-06-24 |
| 60 | Gemini 1.5 Flash (May 2024) | 25.12 | reproduced· optimized | 2024-05-10 |
| 61 | Mistral Large | 24.46 | reproduced· optimized | 2024-02-26 |
| 62 | Mixtral 8x22B | 24.24 | reproduced· optimized | 2024-04-17 |
| 63 | GPT-4 (Jun 2023) | 22.97 | reproduced· optimized | 2023-06-13 |
| 64 | Llama 3.1-8B | 22.88 | reproduced· optimized | 2024-07-23 |
| 65 | Llama 3-70B | 22.55 | reproduced· optimized | 2024-04-18 |
| 66 | Gemma 2 9B | 21.01 | reproduced· optimized | 2024-06-24 |
| 67 | Claude 3 Sonnet | 18.17 | reproduced· optimized | 2024-03-04 |
| 68 | phi-3-medium 14B | 17.56 | reproduced· optimized | 2024-04-23 |
| 69 | GPT-3.5 Turbo (Nov 2023) | 15.89 | reproduced· optimized | 2023-06-13 |
| 70 | Claude 3 Haiku | 14.88 | reproduced· optimized | 2024-03-04 |
| 71 | Claude 2 | 11.73 | reproduced· optimized | 2023-07-11 |
| 72 | GPT-3.5 Turbo (Jan 2024) | 11.63 | reproduced· optimized | 2023-06-13 |
| 73 | Gemini 1.0 Pro | 11.24 | reproduced· optimized | 2023-12-06 |
| 74 | Mistral NeMo | 10.83 | reproduced· optimized | 2024-07-18 |
| 75 | Mixtral 8x7B | 9.95 | reproduced· optimized | 2023-12-11 |
| 76 | Llama 3-8B | 6.13 | reproduced· optimized | 2024-04-18 |
| 77 | Yi-34B | 5.15 | reproduced· optimized | 2023-11-02 |
| 78 | Llama 2-70B | 3.29 | reproduced· optimized | 2023-07-18 |