Models × benchmarks
Every model scored on a benchmark, plotted against what it costs, how big it is or when it arrived — with the frontier drawn through it. A model below the line was never the best value at its price, its size or its date.
266 models with a score · 3011 scores on record · 557 independently reproduced · 29 labs
185 models on this benchmark, plotted against price · the line is the frontier, the best score reached so far
Point at a model to read its score, its evidence tier and what it costs. Every point is a model scored on GPQA diamond.
The frontier is the line: the best score the field had reached at each point on the axis. Below it, a model was never the best value for its price, size or date.
| # | Model | Evidence | Score | Price | Size | Released |
|---|---|---|---|---|---|---|
| 1 | GPT-6.2 AstraOpenAI | unverified | 99.78 | — | unclassified | 2026-11-17 |
| 2 | Gemini 4 CarbonGoogle DeepMind | unverified | 99.34 | — | unclassified | 2026-11-10 |
| 3 | Gemini 4 ArgonGoogle DeepMind | unverified | 99.17 | — | unclassified | 2026-10-13 |
| 4 | Claude Fable 5.2Anthropic | unverified | 98.64 | — | unclassified | 2026-11-09 |
| 5 | GPT-6 AstraOpenAI | unverified | 98.29 | — | unclassified | 2026-09-03 |
| 6 | Claude Sonnet 5.5Anthropic | unverified | 98.03 | — | unclassified | 2026-09-28 |
| 7 | Gemini 3.8 FlashGoogle DeepMind | unverified | 97.77 | — | unclassified | 2026-09-02 |
| 8 | GPT-6.1 SolOpenAI | unverified | 97.77 | — | unclassified | 2026-09-29 |
| 9 | Gemini 3.7 FlashGoogle DeepMind | reproduced | 96.98 | — | unclassified | 2026-08-13 |
| 10 | GPT-5.4 ProOpenAI | reproduced | 96.67 | $67.50 | unclassified | 2026-03-05 |
| 11 | Gemini 3.1 ProGoogle DeepMind | reproduced | 96.45 | $4.50 | unclassified | 2026-02-19 |
| 12 | GPT-6 SolOpenAI | unverified | 96.28 | — | unclassified | 2026-09-22 |
| 13 | GPT-6.1 TerraOpenAI | unverified | 96.28 | — | unclassified | 2026-10-26 |
| 14 | Kimi K3.1 ProMoonshot AI | unverified | 96.1 | — | unclassified | 2026-10-23 |
| 15 | Gemini 3.6 FlashGoogle DeepMind | reproduced | 96.01 | — | unclassified | 2026-07-21 |
| 16 | Claude Opus 5.5Anthropic | unverified | 95.92 | — | unclassified | 2026-09-22 |
| 17 | Grok 4.6xAI | reproduced | 95.84 | — | unclassified | 2026-08-12 |
| 18 | GPT-5.5OpenAI | reproduced | 95.84 | $11.25 | unclassified | 2026-04-23 |
| 19 | GPT-5.5 ProOpenAI | reproduced | 95.72 | $67.50 | unclassified | 2026-04-23 |
| 20 | Claude Fable 5Anthropic | unverified | 95.66 | $20.00 | unclassified | 2026-06-09 |
| 21 | Claude Opus 5Anthropic | reproduced | 95.66 | — | unclassified | 2026-07-24 |
| 22 | GPT-5.6 SolOpenAI | reproduced | 95.14 | $8.00 | unclassified | 2026-07-09 |
| 23 | Grok 4.5xAI | reproduced | 95.05 | — | unclassified | 2026-07-08 |
| 24 | GPT-5.6 TerraOpenAI | reproduced | 94.87 | $4.50 | unclassified | 2026-07-09 |
| 25 | GPT-5.4OpenAI | reproduced | 94.86 | $5.63 | unclassified | 2026-03-05 |
| 26 | DeepSeek V4.1 Flash 1017DeepSeek | unverified | 94.7 | — | unclassified | 2026-10-17 |
| 27 | Kimi K3Moonshot AI | reproduced | 94.61 | — | unclassified | 2026-07-16 |
| 28 | Gemini 3.5 FlashGoogle DeepMind | reproduced | 94.17 | $3.38 | unclassified | 2026-05-19 |
| 29 | Grok 4.7xAI | unverified | 94.08 | — | unclassified | 2026-09-21 |
| 30 | Qwen 3.8 MaxQwen | reproduced | 94 | — | unclassified | 2026-08-02 |
| 31 | Gemini 3 ProGoogle DeepMind | reproduced | 93.91 | $4.50 | unclassified | 2025-11-18 |
| 32 | Qwen3.8 Max (0902)Qwen | unverified | 93.47 | — | unclassified | 2026-09-01 |
| 33 | GLM-5.2Zhipu AI · open weights | reproduced | 92.86 | $1.71 | large | 2026-06-16 |
| 34 | DeepSeek V4 Pro 0813DeepSeek | reproduced | 92.59 | — | unclassified | 2026-08-13 |
| 35 | GPT-5.6 LunaOpenAI | reproduced | 92.5 | $0.45 | unclassified | 2026-07-09 |
| 36 | GPT-5.2OpenAI | reproduced | 92.22 | $4.81 | unclassified | 2025-12-11 |
| 37 | Claude Opus 4.8Anthropic | reproduced | 91.72 | $10.00 | unclassified | 2026-05-28 |
| 38 | DeepSeek V4 Flash 0731DeepSeek | reproduced | 91.72 | — | unclassified | 2026-07-31 |
| 39 | DeepSeek-V4-ProDeepSeek · open weights | reproduced | 91.54 | $1.05 | large | 2026-04-22 |
| 40 | MiniMax-M3MiniMax | unverified | 91.54 | — | unclassified | 2026-06-01 |
| 41 | Qwen3.7-MaxQwen | reproduced | 91.54 | $2.21 | unclassified | 2026-05-19 |
| 42 | GLM-5.3Zhipu AI | unverified | 91.54 | — | unclassified | 2026-08-14 |
| 43 | Kimi K2.6NVIDIA · open weights | reproduced | 91.37 | $1.34 | unclassified | 2026-05-11 |
| 44 | Claude Opus 4.6Anthropic | reproduced | 91.01 | $10.00 | unclassified | 2026-02-05 |
| 45 | Claude Sonnet 5Anthropic | reproduced | 91.01 | $4.00 | unclassified | 2026-06-30 |
| 46 | GPT-6 LunaOpenAI | unverified | 90.93 | — | unclassified | 2026-09-22 |
| 47 | Mistral Large 4Mistral AI | unverified | 90.49 | — | unclassified | 2026-10-29 |
| 48 | Claude Opus 4.7Anthropic | reproduced | 90.49 | $10.00 | unclassified | 2026-04-16 |
| 49 | GLM-5.3-FlashZhipu AI | unverified | 90.49 | — | unclassified | 2026-08-20 |
| 50 | GLM-5.1Zhipu AI | reproduced | 90.14 | $1.83 | unclassified | 2026-04-07 |
| 51 | DeepSeek V4.1 FlashDeepSeek | unverified | 90.05 | — | unclassified | 2026-09-09 |
| 52 | Muse SparkMeta AI | reproduced | 90 | — | unclassified | 2026-04-08 |
| 53 | Claude Haiku 5.5Anthropic | unverified | 89.79 | — | unclassified | 2026-10-07 |
| 54 | Gemini 3 FlashGoogle DeepMind | reproduced | 89.44 | $1.13 | unclassified | 2025-12-17 |
| 55 | Grok 4.20xAI | reproduced | 89.35 | $1.56 | unclassified | 2026-02-17 |
| 56 | Grok 4.3 BetaxAI | reproduced | 88.65 | — | unclassified | 2026-04-17 |
| 57 | Muse Spark OpenMeta AI | unverified | 88.3 | — | unclassified | 2026-10-15 |
| 58 | Inkling-Small— | reproduced | 88.21 | — | unclassified | 2026-07-15 |
| 59 | Qwen 3.6 PlusQwen | reproduced | 88.03 | $0.73 | unclassified | 2026-03-31 |
| 60 | Inkling— | reproduced | 87.86 | — | unclassified | 2026-07-15 |
| 61 | Mistral Large 4 PreviewMistral AI | unverified | 87.59 | — | unclassified | 2026-10-06 |
| 62 | Kimi K2.7 CodeMoonshot AI | reproduced | 87.33 | $1.32 | unclassified | 2026-06-12 |
| 63 | Qwen3.7-PlusQwen | reproduced | 87.33 | — | unclassified | 2026-06-02 |
| 64 | GLM-5Zhipu AI · open weights | reproduced | 87.25 | $1.55 | large | 2026-02-11 |
| 65 | GPT-5.1OpenAI | reproduced | 86.98 | $3.44 | unclassified | 2025-11-13 |
| 66 | Kimi K2.5Moonshot AI | reproduced | 86.94 | $1.00 | unclassified | 2026-01-27 |
| 67 | Qwen 3.6 Max (Preview)Qwen | reproduced | 86.63 | $2.85 | unclassified | 2026-04-20 |
| 68 | Claude Sonnet 4.6Anthropic | reproduced | 86.63 | $6.00 | unclassified | 2026-02-17 |
| 69 | Grok 4xAI | reproduced | 86.11 | $6.00 | unclassified | 2025-07-09 |
| 70 | GPT-5.4 MiniOpenAI | reproduced | 85.93 | $1.69 | unclassified | 2026-03-17 |
| 71 | Qwen3.5 397B-A17BQwen | unverified | 85.23 | — | unclassified | 2026-02-13 |
| 72 | GPT-5OpenAI | reproduced | 84.96 | $3.44 | unclassified | 2025-08-07 |
| 73 | Claude Opus 4.5Anthropic | reproduced | 84.79 | $10.00 | unclassified | 2025-11-24 |
| 74 | Qwen3.6 27BQwen | unverified | 84.53 | — | unclassified | 2026-04-22 |
| 75 | Nemotron 3 UltraNVIDIA | unverified | 83.82 | — | unclassified | 2026-06-04 |
| 76 | Gemini 2.5 Pro (Jun 2025)Google DeepMind | reproduced | 83.74 | — | unclassified | 2025-06-05 |
| 77 | Qwen 3.5 Plus (hosted 397B-A17B)Qwen | reproduced | 83.12 | — | large | 2026-02-16 |
| 78 | Qwen 3.6 35B-A3BQwen | reproduced | 83.12 | — | small | 2026-04-14 |
| 79 | Kimi K2 ThinkingMoonshot AI | reproduced | 82.25 | $1.07 | unclassified | 2025-11-06 |
| 80 | Gemini 2.5 Pro (Mar 2025)Google DeepMind | reproduced | 81.72 | — | unclassified | 2025-03-25 |
| 81 | Qwen3.5-35B-A3BQwen | unverified | 81.19 | — | unclassified | 2026-02-24 |
| 82 | DeepSeek-V3.2DeepSeek · open weights | reproduced | 81.14 | $0.29 | large | 2025-12-01 |
| 83 | Gemini 3.5 Flash-LiteGoogle DeepMind | reproduced | 81.02 | — | unclassified | 2026-07-21 |
| 84 | Qwen 3.6 FlashQwen | reproduced | 81.02 | $0.42 | unclassified | 2026-04-27 |
| 85 | GLM-4.7Zhipu AI | reproduced | 81.02 | $0.74 | unclassified | 2025-12-22 |
| 86 | Qwen 3.5 Flash (hosted 35B-A3B)Qwen | reproduced | 79.62 | — | small | 2026-02-25 |
| 87 | Claude Sonnet 4.5Anthropic | reproduced | 79.62 | $6.00 | unclassified | 2025-09-29 |
| 88 | Gemini 3.1 Flash-LiteGoogle DeepMind | reproduced | 78.91 | $0.56 | unclassified | 2026-03-03 |
| 89 | o3OpenAI | reproduced | 78.91 | $3.50 | unclassified | 2025-04-16 |
| 90 | Qwen3-235B-A22B-Thinking (Jul 2025)Qwen | reproduced | 76.46 | — | large | 2025-07-25 |
| 91 | Claude 3.7 SonnetAnthropic | reproduced | 76.02 | $6.00 | unclassified | 2025-02-24 |
| 92 | o4-miniOpenAI | reproduced | 75.85 | $1.93 | unclassified | 2025-04-16 |
| 93 | Claude Sonnet 4Anthropic | reproduced | 75.26 | $6.60 | unclassified | 2025-05-22 |
| 94 | Qwen3.5-9BQwen | unverified | 74.97 | — | unclassified | 2026-02-24 |
| 95 | GPT-5.4 NanoOpenAI | reproduced | 74.26 | $0.46 | unclassified | 2026-03-17 |
| 96 | Claude Opus 4.1Anthropic | reproduced | 72.6 | $30.00 | unclassified | 2025-08-05 |
| 97 | o3-miniOpenAI | reproduced | 72.25 | $2.12 | unclassified | 2025-01-31 |
| 98 | o1OpenAI | reproduced | 71.9 | $28.88 | unclassified | 2024-12-17 |
| 99 | DeepSeek-R1DeepSeek · open weights | contradicted | 71.5 | $0.32 | large | 2025-01-20 |
| 100 | DeepSeek-R1 (May 2025)DeepSeek | reproduced | 71.29 | — | unclassified | 2025-05-28 |
| 101 | Grok-3 minixAI | reproduced | 71.2 | $0.35 | unclassified | 2025-06-24 |
| 102 | Claude Opus 4Anthropic | reproduced | 71.2 | $33.00 | unclassified | 2025-05-22 |
| 103 | gpt-oss-120bOpenAI · open weights | reproduced | 70.5 | $0.26 | medium | 2025-08-04 |
| 104 | Gemma 4 31B ITGoogle DeepMind | reproduced | 70.5 | — | small | 2026-04-02 |
| 105 | Grok 3xAI | reproduced | 70.5 | $6.00 | unclassified | 2025-04-09 |
| 106 | GPT-5 miniOpenAI | reproduced | 69.44 | $0.69 | unclassified | 2025-08-07 |
| 107 | Gemma 4 26B A4BGoogle DeepMind | unverified | 66.99 | — | unclassified | 2026-04-02 |
| 108 | Qwen3-MaxQwen | reproduced | 66.11 | $3.69 | unclassified | 2025-09-24 |
| 109 | DeepSeek-R1-Distill-Llama-70BDeepSeek · open weights | self-reported | 65.2 | — | medium | 2025-01-20 |
| 110 | DeepSeek-R1DeepSeek · open weights | contradicted | 64.88 | $0.32 | large | 2025-01-20 |
| 111 | Claude Haiku 4.5Anthropic | reproduced | 64.18 | $2.00 | unclassified | 2025-10-15 |
| 112 | Qwen3-235B-A22BQwen · open weights | reproduced | 63.48 | $0.27 | large | 2025-04-27 |
| 113 | Qwen3-30B-A3B-Thinking (Jul 2025)Qwen | unverified | 62.61 | — | unclassified | 2025-07-30 |
| 114 | DeepSeek-R1-Distill-Qwen-32BDeepSeek · open weights | self-reported | 62.1 | — | small | 2025-01-20 |
| 115 | GPT-5 nanoOpenAI | reproduced | 61.73 | $0.14 | unclassified | 2025-08-07 |
| 116 | GPT-4.5OpenAI | reproduced | 60.68 | — | unclassified | 2025-02-27 |
| 117 | DeepSeek-V3 (Mar 2025)DeepSeek | reproduced | 59.19 | — | unclassified | 2025-03-24 |
| 118 | DeepSeek-V3DeepSeek · open weights | contradicted | 59.1 | $0.46 | large | 2024-12-25 |
| 119 | DeepSeek-R1-Distill-Qwen-14BDeepSeek | self-reported | 59.1 | — | small | 2025-01-20 |
| 120 | Llama 4 MaverickMeta AI | reproduced | 58.31 | $0.51 | unclassified | 2025-04-05 |
| 121 | GPT-4.1OpenAI | reproduced | 58.22 | $3.50 | unclassified | 2025-04-14 |
| 122 | Gemini 2.5 Pro (May 2025)Google DeepMind | reproduced | 57.87 | — | unclassified | 2025-05-06 |
| 123 | GPT-4.1 miniOpenAI | reproduced | 56.73 | $0.70 | unclassified | 2025-04-14 |
| 124 | Qwen3-32BQwen | unverified | 56.56 | $0.13 | unclassified | 2025-04-29 |
| 125 | Gemini 2.0 ProGoogle DeepMind | reproduced | 56.47 | — | unclassified | 2025-02-05 |
| 126 | QwQ-32B— | unverified | 56.03 | — | unclassified | 2025-03-05 |
| 127 | Gemini 2.0 Flash (Feb 2025)Google DeepMind | reproduced | 54.36 | — | unclassified | 2025-02-05 |
| 128 | Qwen3-14BQwen | unverified | 53.84 | $0.15 | unclassified | 2025-04-29 |
| 129 | o1-miniOpenAI | reproduced | 51.91 | — | unclassified | 2024-09-12 |
| 130 | Qwen3-30B-A3BQwen | unverified | 50.94 | $0.21 | unclassified | 2025-04-29 |
| 131 | gpt-oss-20bOpenAI · open weights | unverified | 49.72 | — | small | 2025-08-04 |
| 132 | DeepSeek-R1-Distill-Qwen-7BDeepSeek | self-reported | 49.1 | — | small | 2025-01-20 |
| 133 | DeepSeek-R1-Distill-Llama-8BDeepSeek | self-reported | 49 | — | small | 2025-01-20 |
| 134 | Mistral Medium 3Mistral AI | reproduced | 47.96 | $0.88 | unclassified | 2025-05-07 |
| 135 | Gemini 1.5 Pro (Sept 2024)Google DeepMind | reproduced | 44.76 | — | unclassified | 2024-09-24 |
| 136 | Gemini 2.0 Flash Thinking (Jan 2025)Google DeepMind | reproduced | 44.54 | — | unclassified | 2025-01-21 |
| 137 | Qwen3-8BQwen | unverified | 44.1 | $0.31 | unclassified | 2025-04-28 |
| 138 | DeepSeek-V3DeepSeek · open weights | contradicted | 43.8 | $0.46 | large | 2024-12-25 |
| 139 | Qwen2.5-MaxQwen | reproduced | 43.23 | — | unclassified | 2025-01-25 |
| 140 | Phi-4Microsoft · open weights | reproduced | 43.14 | $0.09 | small | 2024-12-11 |
| 141 | Qwen3-30B-A3B-Instruct (Jul 2025)Qwen | unverified | 42.53 | — | unclassified | 2025-07-29 |
| 142 | Claude 3.5 Sonnet (October 2024)Anthropic | reproduced | 42.09 | — | unclassified | 2024-10-22 |
| 143 | Claude 3.5 SonnetAnthropic | reproduced | 40.33 | — | unclassified | 2024-06-20 |
| 144 | Grok-2 (Dec 2024)xAI | reproduced | 39.98 | — | unclassified | 2024-12-12 |
| 145 | Llama 4 ScoutMeta AI | reproduced | 37.27 | $0.15 | unclassified | 2025-04-05 |
| 146 | Llama 3.1-405BMeta AI | reproduced | 35.99 | — | large | 2024-07-23 |
| 147 | o1-previewOpenAI | reproduced | 35.16 | — | unclassified | 2024-09-12 |
| 148 | DeepSeek-R1-Distill-Qwen-1.5BDeepSeek · open weights | self-reported | 33.8 | — | tiny | 2025-01-20 |
| 149 | GPT-4o (Aug 2024)OpenAI | reproduced | 33.63 | — | unclassified | 2024-08-06 |
| 150 | Qwen2.5-72BQwen | reproduced | 33.54 | — | medium | 2024-09-19 |
| 151 | Mistral Large 2 (Jul 2024)Mistral AI | reproduced | 33.36 | — | unclassified | 2024-07-24 |
| 152 | GPT-4.1 nanoOpenAI | reproduced | 33.23 | $0.18 | unclassified | 2025-04-14 |
| 153 | GPT-4o (May 2024)OpenAI | reproduced | 33.19 | — | unclassified | 2024-05-13 |
| 154 | GPT-4o (Nov 2024)OpenAI | reproduced | 31.78 | — | unclassified | 2024-11-20 |
| 155 | Gemma 3 27BGoogle DeepMind | unverified | 31.57 | — | small | 2025-03-12 |
| 156 | Llama 3.3 70BMeta AI · open weights | reproduced | 31.17 | $0.71 | medium | 2024-11-26 |
| 157 | Gemini 1.5 Flash (Sep 2024)Google DeepMind | reproduced | 31 | — | unclassified | 2024-09-24 |
| 158 | Claude 3 OpusAnthropic | reproduced | 30.78 | — | unclassified | 2024-02-29 |
| 159 | GPT-4 Turbo (Apr 2024)OpenAI | reproduced | 29.99 | — | unclassified | 2024-04-09 |
| 160 | Gemini 1.5 Pro (May 2024)Google DeepMind | reproduced | 28.98 | — | unclassified | 2024-05-14 |
| 161 | Llama 3.1-70BMeta AI | reproduced | 26.66 | — | medium | 2024-07-23 |
| 162 | GPT-4 Turbo (Nov 2023)OpenAI | reproduced | 24.11 | — | unclassified | 2024-01-25 |
| 163 | Llama 3.2 90BMeta AI | reproduced | 22.27 | — | medium | 2024-09-24 |
| 164 | Qwen2-72BQwen | reproduced | 21.92 | — | medium | 2024-06-07 |
| 165 | Claude 3 SonnetAnthropic | reproduced | 21.66 | — | unclassified | 2024-02-29 |
| 166 | Llama 3-70BMeta AI | reproduced | 21.61 | — | medium | 2024-04-18 |
| 167 | Gemini 1.5 Flash (May 2024)Google DeepMind | reproduced | 21.35 | — | unclassified | 2024-05-23 |
| 168 | Mistral LargeMistral AI | reproduced | 19.11 | $3.00 | unclassified | 2024-02-26 |
| 169 | Claude 3.5 HaikuAnthropic | reproduced | 18.24 | — | unclassified | 2024-10-22 |
| 170 | GPT-4o miniOpenAI | reproduced | 17.67 | $0.26 | unclassified | 2024-07-18 |
| 171 | Gemma 2 27BGoogle DeepMind | reproduced | 15.96 | — | small | 2024-06-24 |
| 172 | Claude 3 HaikuAnthropic | reproduced | 15.7 | $0.50 | unclassified | 2024-03-07 |
| 173 | GPT-4 (Mar 2023)OpenAI | reproduced | 14.91 | — | unclassified | 2023-03-14 |
| 174 | Claude 2Anthropic | reproduced | 13.42 | — | unclassified | 2023-07-11 |
| 175 | Mixtral 8x22BMistral AI | reproduced | 12.58 | — | unclassified | 2024-04-17 |
| 176 | GPT-4 (Jun 2023)OpenAI | reproduced | 7.85 | — | unclassified | 2023-06-13 |
| 177 | Mixtral 8x7BMistral AI | reproduced | 7.76 | — | unclassified | 2023-12-11 |
| 178 | Mistral NeMoMistral AI | reproduced | 6.8 | $0.03 | unclassified | 2024-07-18 |
| 179 | GPT-3.5 Turbo (Nov 2023)OpenAI | reproduced | 4.21 | — | unclassified | 2023-11-06 |
| 180 | phi-3-medium 14BMicrosoft | reproduced | 3.59 | — | small | 2024-04-23 |
| 181 | Gemma 2 9BGoogle DeepMind | reproduced | 3.42 | — | small | 2024-06-24 |
| 182 | GPT-3.5 Turbo (Jan 2024)OpenAI | reproduced | 3.03 | — | unclassified | 2024-01-25 |
| 183 | Llama 3.1-8BMeta AI · open weights | unverified | 2.72 | — | small | 2024-07-14 |
| 184 | Llama 2-70BMeta AI | reproduced | 1.84 | — | medium | 2023-07-18 |
| 185 | Llama 3-8BMeta AI | reproduced | 1.49 | — | small | 2024-04-18 |
Scores on GPQA diamond. Price is the blended cost per million tokens (3× input + 1× output); a model with no published price on both sides has no price here.
The record holds what the sources publish. A model with no score on the benchmark, no published price, or no parameter count is not plotted rather than estimated. How the record is checked