Google DeepMind·released 2025-06-05
Scored on 23 benchmarks. 30% of its scores are independently reproduced — the rest are self-reported or unverified.
Every score, ranked, colored by evidence status.
| Benchmark | Score | Evidence status | Measured |
|---|---|---|---|
| Fiction.LiveBench | 91.7accuracy (%) | unverified | 2025-06-05 |
| Lech Mazur Writing | 86.02accuracy (%) | unverified | 2025-06-05 |
| OTIS Mock AIME 2024-2025 | 84.71accuracy (%) | reproduced· optimized | 2025-06-05 |
| Aider polyglot | 83.1accuracy (%) | unverified· optimized | 2025-06-05 |
| GPQA diamond | 80.39accuracy (%) | reproduced· optimized | 2025-06-05 |
| SWE-Bench verified | 57.56accuracy (%) | reproduced· optimized | 2025-06-05 |
| SimpleQA Verified | 56accuracy (%) | reproduced | 2025-06-05 |
| SimpleBench | 54.88accuracy (%) | unverified | 2025-06-05 |
| WeirdML | 54.03accuracy (%) | unverified | 2025-06-05 |
| DeepResearch Bench | 49.71accuracy (%) | unverified | 2025-06-05 |
| ARC-AGI | 41accuracy (%) | unverified· optimized | 2025-06-05 |
| Terminal Bench | 32.6accuracy (%) | unverified· optimized | 2025-06-05 |
| FrontierMath-Tiers-1-3-v2-Private | 24.56accuracy (%) | reproduced | 2025-06-05 |
| GDPval | 23.3accuracy (%) | unverified | 2025-06-05 |
| Chess Puzzles | 20accuracy (%) | reproduced | 2025-06-05 |
| VPCT | 19.6accuracy (%) | unverified | 2025-06-05 |
| HLE | 17.69accuracy (%) | unverified | 2025-06-05 |
| APEX-Agents | 6.6accuracy (%) | unverified | 2025-06-05 |
| ARC-AGI-2 | 4.86accuracy (%) | unverified | 2025-06-05 |
| GSO-Bench | 3.92accuracy (%) | unverified | 2025-06-05 |
| CritPt | 2accuracy (%) | unverified | 2025-06-05 |
| Remote Labor Index | 0.83accuracy (%) | unverified | 2025-06-05 |
| FrontierMath-Tier-4-v2-Private | 0accuracy (%) | reproduced | 2025-06-05 |