Benchmark explainer
What is SimpleQA Verified?
unknown
SimpleQA Verified as reported in Epoch AI's Capabilities Index CSV.
How it's scored
- Metric
- normalized performance in Epoch CSV, rendered as accuracy (%)
- Score ceiling
- 100
- Construction
- unknown
- Human baseline
- unknown
How trustworthy
Discrimination
100/100Does it still separate models?
Saturation headroom
98.9/100How far from ceiling / clustered at the top?
Contamination resistance
100/100Public vs held-out; training-leak risk.
Harness comparability
100/100Is it apples-to-apples, or mixed / vendor-optimized?
Freshness
100/100How old is the benchmark?
Contamination history: unknown
Limitations: unknown
Who leads SimpleQA Verified
| Model | Score | Evidence |
|---|---|---|
| Gemini 3.1 Pro | 77.3 | reproduced |
| Gemini 3 Pro | 72.9 | reproduced |
| GPT-5.6 Sol | 71.6 | reproduced |
| Gemini 3.7 Flash | 71.2 | reproduced |
| Gemini 3.6 Flash | 68.7 | reproduced |
Frequently asked questions
SimpleQA Verified: SimpleQA Verified as reported in Epoch AI's Capabilities Index CSV.
Gemini 3.1 Pro leads SimpleQA Verified at 77.3 — independently reproduced. The full leaderboard above lists every recorded measurement, not just the headline number.
68 models have recorded scores on SimpleQA Verified, spanning a score spread of 71.4.
tensor.news grades SimpleQA Verified A for integrity (score 100/100), ranking #4 of 61 benchmarks we assess across discrimination, saturation, contamination resistance, harness comparability, and freshness.
No — SimpleQA Verified still has headroom and continues to discriminate between models rather than bunching them at the ceiling.
Its test set is unknown, so contamination risk is on the table: a high score may partly reflect training-data overlap rather than capability.
Scores are reported under a consistent harness, so comparisons on SimpleQA Verified are reasonably apples-to-apples.
Every SimpleQA Verified measurement is source-backed and tagged reproduced, self-reported, or unverified; the underlying record cites epoch.ai/data/eci_benchmarks.csv.