Google DeepMind·released 2025-04-17
Scored on 10 benchmarks. 10% of its scores are independently reproduced — the rest are self-reported or unverified.
Every score, ranked, colored by evidence status.
| Benchmark | Score | Evidence status | Measured |
|---|---|---|---|
| Lech Mazur Writing | 76.5accuracy (%) | unverified | 2025-04-17 |
| OTIS Mock AIME 2024-2025 | 73.03accuracy (%) | reproduced· optimized | 2025-04-17 |
| GeoBench | 73accuracy (%) | unverified | 2025-04-17 |
| Fiction.LiveBench | 47.2accuracy (%) | unverified | 2025-04-17 |
| Aider polyglot | 47.1accuracy (%) | unverified· optimized | 2025-04-17 |
| WeirdML | 40.95accuracy (%) | unverified | 2025-04-17 |
| ARC-AGI | 32.3accuracy (%) | unverified· optimized | 2025-04-17 |
| DeepResearch Bench | 29.19accuracy (%) | unverified | 2025-04-17 |
| HLE | 7.65accuracy (%) | unverified | 2025-04-17 |
| VPCT | 7accuracy (%) | unverified | 2025-04-17 |