tensor.news
Integrity IndexModelsCompareLabsPapersMethodologyAbout
tensor.news

© 2026

Evidence

  • Integrity Index
  • Model Claim Ledger
  • Compare

Entities

  • Models
  • Benchmarks
  • Labs
  • Papers

Method

  • Methodology
  • About
  • Privacy

Machine

  • Feed (Atom)
  • llms.txt
  • llms-full.txt
  • Sitemap

tensor.news grades benchmarks and tags model claims by evidence status. Every fact carries a source record and provenance. Scores are framed as task performance under a disclosed harness, never as deployed capability.

← Integrity Index

GPQA diamond

Graduate-Level Google-Proof Q&A (Diamond)

Rank #31 of 51 · 122 models scored · top score 92.8

BINTEGRITY 81 / 100

Graduate-level bio/chem/physics reasoning, hard even with web access

Strongest on discrimination, weakest on contamination resistance. Caveat: the public test set leaves contamination on the table.

consistent harnesspublic test set

Headroom to ceiling

7.2 headroomtop 92.8ceiling 100

Score distribution

median 56GPT-5.4 Pro 92.8048.597

State of the art over time

0499792.820232026

Integrity breakdown

Weighted composite. Each signal is computed from the source-backed leaderboard below.

Discrimination30%100

Does it still separate models?

Saturation headroom30%96

How far from ceiling / clustered at the top?

Contamination resistance15%6

Public vs held-out; training-leak risk.

Harness comparability15%100

Apples-to-apples, or mixed / vendor-optimized?

Freshness10%67

How old is the benchmark?

Leaderboard

#ModelScoreEvidenceMeasured
1GPT-5.4 Pro92.8reproduced· optimized2026-03-05
2Gemini 3.1 Pro92.13reproduced· optimized2026-02-19
3GPT-5.592reproduced· optimized2026-04-23
4GPT-5.5 Pro91.9reproduced· optimized2026-04-23
5GPT-5.491.07reproduced· optimized2026-03-05
6Gemini 3.5 Flash90.4reproduced· optimized2026-05-19
7Gemini 3 Pro90.15reproduced· optimized2025-11-18
8GLM-5.289.14reproduced· optimized2026-06-16
9Qwen3.7-Max88.8reproduced· optimized2026-05-19
10GPT-5.288.53reproduced· optimized2025-12-11
11Claude Opus 4.888.05reproduced· optimized2026-05-28
12Kimi K2.687.71reproduced· optimized2026-04-20
13Claude Opus 4.687.37reproduced· optimized2026-02-05
14Claude Opus 4.786.87reproduced· optimized2026-04-16
15Muse Spark86.4reproduced· optimized2026-04-08
16DeepSeek-V4-Pro86.2reproduced· optimized2026-04-24
17Kimi K2.7 Code86.03reproduced· optimized2026-06-12
18Qwen 3.6 Max (Preview)85.44reproduced· optimized2026-04-20
19Grok 4.3 Beta85.1reproduced· optimized2026-04-17
20GLM-583.76reproduced· optimized2026-02-11
21GPT-5.183.5reproduced· optimized2025-11-13
22Kimi K2.583.47reproduced· optimized2026-02-02
23Qwen 3.6 Plus83.16reproduced· optimized2026-04-01
24Claude Sonnet 4.683.16reproduced· optimized2026-02-17
25Grok 482.67reproduced· optimized2025-07-09
26GPT-581.57reproduced· optimized2025-08-07
27Claude Opus 4.581.4reproduced· optimized2025-11-24
28GLM-5.180.64reproduced· optimized2026-04-07
29Gemini 2.5 Pro (Jun 2025)80.39reproduced· optimized2025-06-05
30Qwen 3.6 Flash79.23reproduced· optimized2026-04-26
31Kimi K2 Thinking78.96reproduced· optimized2025-11-06
32Qwen 3.5 Plus (hosted 397B-A17B)78.87reproduced· optimized2026-02-16
33Qwen 3.5 Flash (hosted 35B-A3B)78.45reproduced· optimized2026-02-25
34Gemini 2.5 Pro (Mar 2025)78.45reproduced· optimized2025-03-25
35GPT-5.4 Mini78.11reproduced· optimized2026-03-17
36DeepSeek-V3.277.9reproduced· optimized2025-12-01
37GLM-4.777.78reproduced· optimized2025-12-22
38Gemini 3 Flash77.61reproduced· optimized2025-12-17
39Claude Sonnet 4.576.43reproduced· optimized2025-09-29
40o375.76reproduced· optimized2024-12-20
41Qwen3-235B-A22B-Thinking (Jul 2025)73.4reproduced· optimized2025-07-25
42Claude 3.7 Sonnet72.98reproduced· optimized2025-02-24
43o4-mini72.81reproduced· optimized2025-04-16
44Claude Sonnet 472.25reproduced· optimized2025-05-22
45GPT-5.4 Nano71.29reproduced· optimized2026-03-17
46Claude Opus 4.169.7reproduced· optimized2025-08-05
47o3-mini69.36reproduced· optimized2025-01-31
48o169.02reproduced· optimized2024-12-05
49DeepSeek-R1 (May 2025)68.43reproduced· optimized2025-05-28
50Grok-3 mini68.35reproduced· optimized2025-02-19
51Claude Opus 468.35reproduced· optimized2025-05-22
52Grok 367.68reproduced· optimized2025-02-17
53gpt-oss-120b67.68reproduced· optimized2025-08-05
54GPT-5 mini66.67reproduced· optimized2025-08-07
55Qwen3-Max63.47reproduced· optimized2025-09-05
56DeepSeek-R162.29reproduced· optimized2025-01-20
57Claude Haiku 4.561.62reproduced· optimized2025-10-15
58Qwen3-235B-A22B60.94reproduced· optimized2025-04-28
59GPT-5 nano59.26reproduced· optimized2025-08-07
60GPT-4.558.25reproduced· optimized2025-02-27
61DeepSeek-V3 (Mar 2025)56.82reproduced· optimized2025-03-24
62Llama 4 Maverick55.98reproduced· optimized2025-04-05
63GPT-4.155.89reproduced· optimized2025-04-14
64Gemini 2.5 Pro (May 2025)55.56reproduced· optimized2025-05-06
65GPT-4.1 mini54.46reproduced· optimized2025-04-14
66Gemini 2.0 Pro54.21reproduced· optimized2024-12-11
67Gemini 2.0 Flash (Feb 2025)52.19reproduced· optimized2024-12-11
68o1-mini49.83reproduced· optimized2024-09-12
69Mistral Medium 346.04reproduced· optimized2025-05-07
70Gemini 1.5 Pro (Sept 2024)42.97reproduced· optimized2024-09-24
71Gemini 2.0 Flash Thinking (Jan 2025)42.76reproduced· optimized2025-01-21
72DeepSeek-V342.05reproduced· optimized2024-12-24
73Qwen2.5-Max41.5reproduced· optimized2025-01-25
74Phi-441.41reproduced· optimized2024-12-12
75Claude 3.5 Sonnet (October 2024)40.4reproduced· optimized2024-10-22
76Claude 3.5 Sonnet38.72reproduced· optimized2024-06-20
77Grok-2 (Dec 2024)38.38reproduced· optimized2024-08-13
78Llama 4 Scout35.77reproduced· optimized2025-04-05
79Mistral Large 2 (Nov 2024)35.1reproduced· optimized2024-07-24
80Llama 3.1-405B34.55reproduced· optimized2024-07-23
81o1-preview33.75reproduced· optimized2024-09-12
82GPT-4o (Aug 2024)32.28reproduced· optimized2024-05-13
83Qwen2.5-72B32.2reproduced· optimized2024-09-19
84Mistral Large 2 (Jul 2024)32.03reproduced· optimized2024-07-24
85GPT-4.1 nano31.9reproduced· optimized2025-04-14
86GPT-4o (May 2024)31.86reproduced· optimized2024-05-13
87Gemma 3 27B31.82reproduced· optimized2025-03-12
88Magistral Small 1.131.23reproduced· optimized2025-06-10
89GPT-4o (Nov 2024)30.51reproduced· optimized2024-05-13
90Mistral Small 3.129.97reproduced· optimized2025-03-17
91Llama 3.3 70B29.92reproduced· optimized2024-12-06
92Gemini 1.5 Flash (Sep 2024)29.76reproduced· optimized2024-05-10
93Claude 3 Opus29.55reproduced· optimized2024-03-04
94GPT-4 Turbo (Apr 2024)28.79reproduced· optimized2024-04-09
95Gemini 1.5 Pro (May 2024)27.82reproduced· optimized2024-05-14
96Llama 3.1-70B25.59reproduced· optimized2024-07-23
97Llama 3.2 90B21.38reproduced· optimized2024-09-24
98Qwen2-72B21.04reproduced· optimized2024-06-07
99Claude 3 Sonnet20.79reproduced· optimized2024-03-04
100Llama 3-70B20.75reproduced· optimized2024-04-18
101Gemini 1.5 Flash (May 2024)20.5reproduced· optimized2024-05-10
102Mistral Large18.35reproduced· optimized2024-02-26
103Claude 3.5 Haiku17.51reproduced· optimized2024-10-22
104GPT-4o mini16.96reproduced· optimized2024-07-18
105Gemma 2 27B15.32reproduced· optimized2024-06-24
106Claude 3 Haiku15.07reproduced· optimized2024-03-04
107GPT-4 (Mar 2023)14.31reproduced· optimized2023-03-15
108Claude 212.88reproduced· optimized2023-07-11
109Mixtral 8x22B12.08reproduced· optimized2024-04-17
110Gemini 1.0 Pro11.95reproduced· optimized2023-12-06
111Claude 2.110.61reproduced· optimized2023-11-21
112GPT-4 (Jun 2023)7.53reproduced· optimized2023-06-13
113Mixtral 8x7B7.45reproduced· optimized2023-12-11
114Mistral NeMo6.52reproduced· optimized2024-07-18
115GPT-3.5 Turbo (Nov 2023)4.04reproduced· optimized2023-06-13
116phi-3-medium 14B3.45reproduced· optimized2024-04-23
117Gemma 2 9B3.28reproduced· optimized2024-06-24
118GPT-3.5 Turbo (Jan 2024)2.9reproduced· optimized2023-06-13
119Llama 2-70B1.77reproduced· optimized2023-07-18
120Llama 3-8B1.43reproduced· optimized2024-04-18
121Llama 3.1-8B1.26reproduced· optimized2024-07-23
122Yi-34B0reproduced· optimized2023-11-02

At a glance

Models scored
122
Top model
GPT-5.4 Pro
Top score
92.8
Score spread
92.8
Headroom
7.2

Benchmark context

Task type
reasoning
Metric
MC accuracy (4-option)
Score ceiling
100
Human baseline
PhD experts ~65% (74% excl. errors); non-experts w/web ~34%
Test-set privacy
public_with_canary
Construction
Expert-written PhD-validated; Diamond=198 items both experts agreed & non-experts failed
Key assumptions
MC accuracy on expert-vetted Qs tracks graduate reasoning; 'Google-proof' blocks lookup
Limitations
Small MC set; recall+elimination not open-ended research; format/self-consistency worth a few pts
Contamination history
Public since 2023 w/ canary but widely circulated; leakage likely for 2025-26 models
Harness notes
Single-shot MC; CoT + self-consistency + test-time compute move it several pts
Authors
NYU/Cohere/Anthropic
Released
2023-11
License
CC BY 4.0
Source
arxiv.org/abs/2311.12022

Provenance

122 source records · scores from epoch_benchmarks. Every fact on this page is evidence-linked.

Follow the record

Integrity neighbors

  • SWE-Bench verifiedB · 83
  • CL-benchB · 82
  • CL-bench LifeB · 81
  • OSWorld 2.0B · 81
  • Remote Labor IndexB · 81
  • OSWorldB · 80

Top models here

  • GPT-5.4 Pro92.8
  • Gemini 3.1 Pro92.13
  • GPT-5.592
  • GPT-5.5 Pro91.9
  • GPT-5.491.07

Head-to-head

  • GPT-5.4 Pro vs Gemini 3.1 Pro
  • GPT-5.4 Pro vs GPT-5.5
  • Gemini 3.1 Pro vs GPT-5.5