Graduate-Level Google-Proof Q&A (Diamond)
Integrity rank #49 of 65 · 194 models scored · top score 95.2 · Gemini 4 Argon
Graduate-level bio/chem/physics reasoning, hard even with web access
Strongest on discrimination, weakest on contamination resistance. Caveat: scores come from an inconsistent mix of harnesses, so head-to-head comparisons are not apples-to-apples.
Reported scores — protocols may differ. How we compare
| # | Model | Score | Evidence | Measured |
|---|---|---|---|---|
| 1 | Gemini 4 Argon | 95.2 | unverifiedT2 | 2026-09-30 |
| 2 | GPT-6 Astra | 94.36 | unverifiedT2 | 2026-09-03 |
| 3 | Claude Sonnet 5.5 | 94.11 | unverifiedT2 | 2026-09-28 |
| 4 | GPT-6.1 Sol | 93.86 | unverifiedT2 | 2026-09-29 |
| 5 | Gemini 3.8 Flash | 93.86 | unverifiedT2 | 2026-09-02 |
| 6 | Gemini 3.7 Flash | 93.1 | reproduced· optimizedT1 | 2026-08-13 |
| 7 | GPT-5.4 Pro | 92.8 | reproduced· optimizedT1 | 2026-03-05 |
| 8 | Gemini 3.1 Pro | 92.59 | reproduced· optimizedT1 | 2026-02-19 |
| 9 | GPT-6 Sol | 92.42 | unverifiedT2 | 2026-09-22 |
| 10 | Gemini 3.6 Flash | 92.17 | reproduced· optimizedT1 | 2026-07-21 |
| 11 | Grok 4.6 | 92 | reproduced· optimizedT1 | 2026-08-12 |
| 12 | GPT-5.5 | 92 | reproduced· optimizedT1 | 2026-04-23 |
| 13 | GPT-5.5 Pro | 91.9 | reproduced· optimizedT1 | 2026-04-23 |
| 14 | Claude Opus 5 | 91.84 | reproduced· optimizedT1 | 2026-07-24 |
| 15 | GPT-5.6 Sol | 91.33 | reproduced· optimizedT1 | 2026-07-09 |
| 16 | Grok 4.5 | 91.25 | reproduced· optimizedT1 | 2026-07-08 |
| 17 | GPT-5.6 Terra | 91.08 | reproduced· optimizedT1 | 2026-07-09 |
| 18 | GPT-5.4 | 91.07 | reproduced· optimizedT1 | 2026-03-05 |
| 19 | Kimi K3 | 90.82 | reproduced· optimizedT1 | 2026-07-16 |
| 20 | Gemini 3.5 Flash | 90.4 | reproduced· optimizedT1 | 2026-05-19 |
| 21 | Grok 4.7 | 90.32 | unverifiedT2 | 2026-09-21 |
| 22 | Qwen 3.8 Max | 90.24 | reproduced· optimizedT1 | 2026-08-02 |
| 23 | Gemini 3 Pro | 90.15 | reproduced· optimizedT1 | 2025-11-18 |
| 24 | Qwen3.8 Max (0902) | 89.73 | unverifiedT2 | 2026-09-01 |
| 25 | GLM-5.2 | 89.14 | reproduced· optimizedT1 | 2026-06-16 |
| 26 | DeepSeek V4 Pro 0813 | 88.89 | reproduced· optimizedT1 | 2026-08-13 |
| 27 | GPT-5.6 Luna | 88.8 | reproduced· optimizedT1 | 2026-07-09 |
| 28 | GPT-5.2 | 88.53 | reproduced· optimizedT1 | 2025-12-11 |
| 29 | Claude Opus 4.8 | 88.05 | reproduced· optimizedT1 | 2026-05-28 |
| 30 | DeepSeek V4 Flash 0731 | 88.05 | reproduced· optimizedT1 | 2026-07-31 |
| 31 | DeepSeek-V4-Pro | 87.88 | reproduced· optimizedT1 | 2026-04-24 |
| 32 | MiniMax-M3 | 87.88 | unverifiedT2 | 2026-06-01 |
| 33 | Qwen3.7-Max | 87.88 | reproduced· optimizedT1 | 2026-05-19 |
| 34 | GLM-5.3 | 87.88 | unverifiedT2 | 2026-08-14 |
| 35 | Kimi K2.6 | 87.71 | reproduced· optimizedT1 | 2026-04-20 |
| 36 | Claude Opus 5.5 | 87.46 | unverifiedT2 | 2026-09-22 |
| 37 | Claude Opus 4.6 | 87.37 | reproduced· optimizedT1 | 2026-02-05 |
| 38 | Claude Sonnet 5 | 87.37 | reproduced· optimizedT1 | 2026-06-30 |
| 39 | GPT-6 Luna | 87.29 | unverifiedT2 | 2026-09-22 |
| 40 | Claude Opus 4.7 | 86.87 | reproduced· optimizedT1 | 2026-04-16 |
| 41 | GLM-5.3-Flash | 86.87 | unverifiedT2 | 2026-08-20 |
| 42 | GLM-5.1 | 86.53 | reproduced· optimizedT1 | 2026-04-07 |
| 43 | DeepSeek V4.1 Flash | 86.45 | unverifiedT2 | 2026-09-09 |
| 44 | Muse Spark | 86.4 | reproduced· optimizedT1 | 2026-04-08 |
| 45 | Claude Haiku 5.5 | 86.2 | unverifiedT2 | 2026-10-07 |
| 46 | Gemini 3 Flash | 85.86 | reproduced· optimizedT1 | 2025-12-17 |
| 47 | Grok 4.20 | 85.77 | reproduced· optimizedT1 | 2026-02-17 |
| 48 | Grok 4.3 Beta | 85.1 | reproduced· optimizedT1 | 2026-04-17 |
| 49 | Inkling-Small | 84.68 | reproduced· optimizedT1 | 2026-07-15 |
| 50 | Qwen 3.6 Plus | 84.51 | reproduced· optimizedT1 | 2026-03-31 |
| 51 | Inkling | 84.34 | reproduced· optimizedT1 | 2026-07-15 |
| 52 | Mistral Large 4 | 84.09 | unverifiedT2 | 2026-10-06 |
| 53 | Kimi K2.7 Code | 83.84 | reproduced· optimizedT1 | 2026-06-12 |
| 54 | Qwen3.7-Plus | 83.84 | reproduced· optimizedT1 | 2026-06-02 |
| 55 | GLM-5 | 83.76 | reproduced· optimizedT1 | 2026-02-11 |
| 56 | GPT-5.1 | 83.5 | reproduced· optimizedT1 | 2025-11-13 |
| 57 | Kimi K2.5 | 83.47 | reproduced· optimizedT1 | 2026-01-27 |
| 58 | Qwen 3.6 Max (Preview) | 83.16 | reproduced· optimizedT1 | 2026-04-20 |
| 59 | Claude Sonnet 4.6 | 83.16 | reproduced· optimizedT1 | 2026-02-17 |
| 60 | Grok 4 | 82.67 | reproduced· optimizedT1 | 2025-07-09 |
| 61 | GPT-5.4 Mini | 82.49 | reproduced· optimizedT1 | 2026-03-17 |
| 62 | Qwen3.5 397B-A17B | 81.82 | unverifiedT2 | 2026-02-13 |
| 63 | GPT-5 | 81.57 | reproduced· optimizedT1 | 2025-08-07 |
| 64 | Claude Opus 4.5 | 81.4 | reproduced· optimizedT1 | 2025-11-24 |
| 65 | Claude Fable 5 | 81.14 | reproduced· optimizedT1 | 2026-06-09 |
| 66 | Qwen3.6 27B | 81.14 | unverifiedT2 | 2026-04-22 |
| 67 | Nemotron 3 Ultra | 80.47 | unverifiedT2 | 2026-06-04 |
| 68 | Gemini 2.5 Pro (Jun 2025) | 80.39 | reproduced· optimizedT1 | 2025-06-05 |
| 69 | Qwen 3.5 Plus (hosted 397B-A17B) | 79.8 | reproduced· optimizedT1 | 2026-02-16 |
| 70 | Qwen 3.6 35B-A3B | 79.8 | reproduced· optimizedT1 | 2026-04-14 |
| 71 | Kimi K2 Thinking | 78.96 | reproduced· optimizedT1 | 2025-11-06 |
| 72 | Gemini 2.5 Pro (Mar 2025) | 78.45 | reproduced· optimizedT1 | 2025-03-25 |
| 73 | Qwen3.5-35B-A3B | 77.95 | unverifiedT2 | 2026-02-24 |
| 74 | DeepSeek-V3.2 | 77.9 | reproduced· optimizedT1 | 2025-12-01 |
| 75 | Gemini 3.5 Flash-Lite | 77.78 | reproduced· optimizedT1 | 2026-07-21 |
| 76 | Qwen 3.6 Flash | 77.78 | reproduced· optimizedT1 | 2026-04-27 |
| 77 | GLM-4.7 | 77.78 | reproduced· optimizedT1 | 2025-12-22 |
| 78 | GPT-5.5 Instant | 76.68 | reproduced· optimizedT1 | 2026-05-05 |
| 79 | Qwen 3.5 Flash (hosted 35B-A3B) | 76.43 | reproduced· optimizedT1 | 2026-02-25 |
| 80 | Qwen3.7 Flash | 76.43 | unverifiedT2 | 2026-07-27 |
| 81 | Claude Sonnet 4.5 | 76.43 | reproduced· optimizedT1 | 2025-09-29 |
| 82 | Gemini 3.1 Flash-Lite | 75.76 | reproduced· optimizedT1 | 2026-03-03 |
| 83 | o3 | 75.76 | reproduced· optimizedT1 | 2025-04-16 |
| 84 | Qwen3-235B-A22B-Thinking (Jul 2025) | 73.4 | reproduced· optimizedT1 | 2025-07-25 |
| 85 | Claude 3.7 Sonnet | 72.98 | reproduced· optimizedT1 | 2025-02-24 |
| 86 | o4-mini | 72.81 | reproduced· optimizedT1 | 2025-04-16 |
| 87 | Claude Sonnet 4 | 72.25 | reproduced· optimizedT1 | 2025-05-22 |
| 88 | Qwen3.5-9B | 71.97 | unverifiedT2 | 2026-02-24 |
| 89 | GPT-5.4 Nano | 71.29 | reproduced· optimizedT1 | 2026-03-17 |
| 90 | Claude Opus 4.1 | 69.7 | reproduced· optimizedT1 | 2025-08-05 |
| 91 | o3-mini | 69.36 | reproduced· optimizedT1 | 2025-01-31 |
| 92 | o1 | 69.02 | reproduced· optimizedT1 | 2024-12-17 |
| 93 | DeepSeek-R1 (May 2025) | 68.43 | reproduced· optimizedT1 | 2025-05-28 |
| 94 | Grok-3 mini | 68.35 | reproduced· optimizedT1 | 2025-04-09 |
| 95 | Claude Opus 4 | 68.35 | reproduced· optimizedT1 | 2025-05-22 |
| 96 | gpt-oss-120b | 67.68 | reproduced· optimizedT1 | 2025-08-05 |
| 97 | Gemma 4 31B IT | 67.68 | reproduced· optimizedT1 | 2026-04-02 |
| 98 | Grok 3 | 67.68 | reproduced· optimizedT1 | 2025-04-09 |
| 99 | GPT-5 mini | 66.67 | reproduced· optimizedT1 | 2025-08-07 |
| 100 | DeepSeek-R1-Distill-Llama-70B | 65.2 | self-reported· optimizedT1 | 2025-01-22 |
| 101 | Gemma 4 26B A4B | 64.31 | unverifiedT2 | 2026-04-02 |
| 102 | Qwen3-Max | 63.47 | reproduced· optimizedT1 | 2025-09-24 |
| 103 | DeepSeek-R1 | 62.29 | reproduced· optimizedT1 | 2025-01-20 |
| 104 | Claude Haiku 4.5 | 61.62 | reproduced· optimizedT1 | 2025-10-15 |
| 105 | Qwen3-235B-A22B | 60.94 | reproduced· optimizedT1 | 2025-04-28 |
| 106 | Qwen3-30B-A3B-Thinking (Jul 2025) | 60.1 | unverifiedT2 | 2025-07-30 |
| 107 | GPT-5 nano | 59.26 | reproduced· optimizedT1 | 2025-08-07 |
| 108 | GPT-4.5 | 58.25 | reproduced· optimizedT1 | 2025-02-27 |
| 109 | DeepSeek-V3 (Mar 2025) | 56.82 | reproduced· optimizedT1 | 2025-03-24 |
| 110 | Llama 4 Maverick | 55.98 | reproduced· optimizedT1 | 2025-04-05 |
| 111 | GPT-4.1 | 55.89 | reproduced· optimizedT1 | 2025-04-14 |
| 112 | Gemini 2.5 Pro (May 2025) | 55.56 | reproduced· optimizedT1 | 2025-05-06 |
| 113 | GPT-4.1 mini | 54.46 | reproduced· optimizedT1 | 2025-04-14 |
| 114 | Qwen3-32B | 54.29 | unverifiedT2 | 2025-04-29 |
| 115 | Gemini 2.0 Pro | 54.21 | reproduced· optimizedT1 | 2025-02-05 |
| 116 | QwQ-32B | 53.79 | unverifiedT2 | 2025-03-05 |
| 117 | Gemini 2.0 Flash (Feb 2025) | 52.19 | reproduced· optimizedT1 | 2025-02-05 |
| 118 | DeepSeek-R1-Distill-Qwen-32B | 52.19 | unverifiedT2 | 2025-01-20 |
| 119 | Qwen3-14B | 51.68 | unverifiedT2 | 2025-04-29 |
| 120 | o1-mini | 49.83 | reproduced· optimizedT1 | 2024-09-12 |
| 121 | DeepSeek-R1-Distill-Qwen-7B | 49.1 | self-reported· optimizedT1 | 2025-01-22 |
| 122 | DeepSeek-R1-Distill-Llama-8B | 49 | self-reported· optimizedT1 | 2025-01-22 |
| 123 | Qwen3-30B-A3B | 48.91 | unverifiedT2 | 2025-04-29 |
| 124 | gpt-oss-20b | 47.73 | unverifiedT2 | 2025-08-05 |
| 125 | Mistral Medium 3 | 46.04 | reproduced· optimizedT1 | 2025-05-07 |
| 126 | Gemini 1.5 Pro (Sept 2024) | 42.97 | reproduced· optimizedT1 | 2024-09-24 |
| 127 | Gemini 2.0 Flash Thinking (Jan 2025) | 42.76 | reproduced· optimizedT1 | 2025-01-21 |
| 128 | Qwen3-8B | 42.34 | unverifiedT2 | 2025-04-28 |
| 129 | DeepSeek-V3 | 42.05 | reproduced· optimizedT1 | 2024-12-26 |
| 130 | Qwen2.5-Max | 41.5 | reproduced· optimizedT1 | 2025-01-25 |
| 131 | Phi-4 | 41.41 | reproduced· optimizedT1 | 2024-12-12 |
| 132 | Magistral Small 1.0 | 41.41 | reproduced· optimizedT1 | 2025-06-10 |
| 133 | Qwen3-30B-A3B-Instruct (Jul 2025) | 40.82 | unverifiedT2 | 2025-07-29 |
| 134 | Claude 3.5 Sonnet (October 2024) | 40.4 | reproduced· optimizedT1 | 2024-10-22 |
| 135 | Claude 3.5 Sonnet | 38.72 | reproduced· optimizedT1 | 2024-06-20 |
| 136 | Grok-2 (Dec 2024) | 38.38 | reproduced· optimizedT1 | 2024-12-12 |
| 137 | Llama 4 Scout | 35.77 | reproduced· optimizedT1 | 2025-04-05 |
| 138 | Mistral Large 2 (Nov 2024) | 35.1 | reproduced· optimizedT1 | 2024-11-18 |
| 139 | Llama 3.1-405B | 34.55 | reproduced· optimizedT1 | 2024-07-23 |
| 140 | DeepSeek-R1-Distill-Qwen-1.5B | 33.8 | self-reported· optimizedT1 | 2025-01-22 |
| 141 | o1-preview | 33.75 | reproduced· optimizedT1 | 2024-09-12 |
| 142 | GPT-4o (Aug 2024) | 32.28 | reproduced· optimizedT1 | 2024-08-06 |
| 143 | Qwen2.5-72B | 32.2 | reproduced· optimizedT1 | 2024-09-19 |
| 144 | Mistral Small 3.2 | 32.07 | unverifiedT2 | 2025-06-20 |
| 145 | Mistral Large 2 (Jul 2024) | 32.03 | reproduced· optimizedT1 | 2024-07-24 |
| 146 | GPT-4.1 nano | 31.9 | reproduced· optimizedT1 | 2025-04-14 |
| 147 | GPT-4o (May 2024) | 31.86 | reproduced· optimizedT1 | 2024-05-13 |
| 148 | GPT-4o (Nov 2024) | 30.51 | reproduced· optimizedT1 | 2024-11-20 |
| 149 | Gemma 3 27B | 30.3 | unverifiedT2 | 2025-03-12 |
| 150 | Magistral Small 1.2 | 30.13 | unverifiedT2 | 2025-09-18 |
| 151 | Mistral Small 3.1 | 29.97 | unverifiedT2 | 2025-03-17 |
| 152 | Llama 3.3 70B | 29.92 | reproduced· optimizedT1 | 2024-12-06 |
| 153 | Gemini 1.5 Flash (Sep 2024) | 29.76 | reproduced· optimizedT1 | 2024-09-24 |
| 154 | Mistral Small 3 | 29.71 | unverifiedT2 | 2025-01-30 |
| 155 | Claude 3 Opus | 29.55 | reproduced· optimizedT1 | 2024-02-29 |
| 156 | GPT-4 Turbo (Apr 2024) | 28.79 | reproduced· optimizedT1 | 2024-04-09 |
| 157 | Qwen2.5-32B | 28.11 | unverifiedT2 | 2024-09-17 |
| 158 | Gemini 1.5 Pro (May 2024) | 27.82 | reproduced· optimizedT1 | 2024-05-14 |
| 159 | DeepSeek-R1-Distill-Qwen-14B | 26.26 | unverifiedT2 | 2025-01-20 |
| 160 | Llama 3.1-70B | 25.59 | reproduced· optimizedT1 | 2024-07-23 |
| 161 | GPT-4 Turbo (Nov 2023) | 23.15 | reproduced· optimizedT1 | 2024-01-25 |
| 162 | Llama 3.2 90B | 21.38 | reproduced· optimizedT1 | 2024-09-24 |
| 163 | Qwen2-72B | 21.04 | reproduced· optimizedT1 | 2024-06-07 |
| 164 | Claude 3 Sonnet | 20.79 | reproduced· optimizedT1 | 2024-02-29 |
| 165 | Llama 3-70B | 20.75 | reproduced· optimizedT1 | 2024-04-18 |
| 166 | Gemini 1.5 Flash (May 2024) | 20.5 | reproduced· optimizedT1 | 2024-05-23 |
| 167 | Gemma 3 12B | 19.28 | unverifiedT2 | 2025-03-12 |
| 168 | Mistral Large | 18.35 | reproduced· optimizedT1 | 2024-02-26 |
| 169 | Claude 3.5 Haiku | 17.51 | reproduced· optimizedT1 | 2024-10-22 |
| 170 | GPT-4o mini | 16.96 | reproduced· optimizedT1 | 2024-07-18 |
| 171 | Gemma 2 27B | 15.32 | reproduced· optimizedT1 | 2024-06-24 |
| 172 | Claude 3 Haiku | 15.07 | reproduced· optimizedT1 | 2024-03-07 |
| 173 | GPT-4 (Mar 2023) | 14.31 | reproduced· optimizedT1 | 2023-03-14 |
| 174 | Qwen2.5-7B | 13.97 | unverifiedT2 | 2024-09-19 |
| 175 | Claude 2 | 12.88 | reproduced· optimizedT1 | 2023-07-11 |
| 176 | Mixtral 8x22B | 12.08 | reproduced· optimizedT1 | 2024-04-17 |
| 177 | Gemini 1.0 Pro | 11.95 | reproduced· optimizedT1 | 2023-12-13 |
| 178 | Claude 2.1 | 10.61 | reproduced· optimizedT1 | 2023-11-21 |
| 179 | GPT-4 (Jun 2023) | 7.53 | reproduced· optimizedT1 | 2023-06-13 |
| 180 | Mixtral 8x7B | 7.45 | reproduced· optimizedT1 | 2023-12-11 |
| 181 | Mistral NeMo | 6.52 | reproduced· optimizedT1 | 2024-07-18 |
| 182 | GPT-3.5 Turbo (Nov 2023) | 4.04 | reproduced· optimizedT1 | 2023-11-06 |
| 183 | phi-3-medium 14B | 3.45 | reproduced· optimizedT1 | 2024-04-23 |
| 184 | Gemma 2 9B | 3.28 | reproduced· optimizedT1 | 2024-06-24 |
| 185 | GPT-3.5 Turbo (Jan 2024) | 2.9 | reproduced· optimizedT1 | 2024-01-25 |
| 186 | Llama 3.1-8B | 2.61 | unverifiedT2 | 2024-07-23 |
| 187 | Llama 2-70B | 1.77 | reproduced· optimizedT1 | 2023-07-18 |
| 188 | Llama 3-8B | 1.43 | reproduced· optimizedT1 | 2024-04-18 |
| 189 | Ministral 3B | 0.34 | unverifiedT2 | 2024-10-16 |
| 190 | Gemma 3 4B | 0 | unverifiedT2 | 2025-03-12 |
| 191 | Llama 3.2 1B | 0 | unverifiedT2 | 2024-09-24 |
| 192 | Mistral 7B v0.3 | 0 | unverifiedT2 | 2024-05-27 |
| 193 | Yi-34B | 0 | reproduced· optimizedT1 | 2023-11-02 |
| 194 | DeepSeek LLM 67B | 0 | unverifiedT2 | 2023-11-29 |
Continue from this leaderboard into the tightest head-to-head reads.
Weighted composite. Each dimension opens to the source-backed sub-signals it is computed from.
Claims drawn from cited facts, not live model generation.
This benchmark tests graduate-level reasoning in biology, chemistry and physics.
1 cited fact
This benchmark has scores from 194 tracked models, with a recorded score range spanning 95.2.
2 cited facts
Its Benchmark Integrity Index score is 73, with grade B and rank 49 out of 65 tracked benchmarks.
4 cited facts
It is flagged as saturated. The top recorded score is 95.2, with 4.8 points of headroom. The computed top-score cluster contains 5 models.
4 cited facts
The harness classification is mixed harness — not directly comparable. Test-set privacy is recorded as public. The recorded contamination-window ratio is 0.97.
3 cited facts
Models with more than one recorded measurement on this benchmark — every one shown, not just the headline number.
GPQA diamond (Graduate-Level Google-Proof Q&A (Diamond)): GPQA Diamond — the hardest 198-question subset of Graduate-level Google-Proof Q&A across biology, chemistry, and physics, authored by PhD-level experts; scored as accuracy (%). PhD-level human experts score ~70% and random guessing ~25%.
Gemini 4 Argon leads GPQA diamond at 95.2. The full leaderboard above lists every recorded measurement, not just the headline number.
194 models have recorded scores on GPQA diamond, spanning a score spread of 95.2.
tensor.news grades GPQA diamond B for integrity (score 73/100), ranking #49 of 65 benchmarks we assess across discrimination, saturation, contamination resistance, harness comparability, and freshness.
Yes — top scores are clustering near the ceiling (saturation ratio 0.03), so GPQA diamond no longer separates leading models well. Treat small gaps at the top with caution.
Its test set is public, so contamination risk is on the table: a high score may partly reflect training-data overlap rather than capability.
Only partly — scores come from a mix of harnesses and protocols, so a head-to-head on GPQA diamond is not fully apples-to-apples.
Every GPQA diamond measurement is source-backed and tagged reproduced, self-reported, or unverified; the underlying record cites arxiv.org/abs/2311.12022.