xAI·released 2026-04-17
Scored on 8 benchmarks. 75% of its scores are independently reproduced — the rest are self-reported or unverified.
Every score, ranked, colored by evidence status.
| Benchmark | Score | Evidence status | Measured |
|---|---|---|---|
| OTIS Mock AIME 2024-2025 | 93.33accuracy (%) | reproduced· optimized | 2026-04-17 |
| GPQA diamond | 85.1accuracy (%) | reproduced· optimized | 2026-04-17 |
| WeirdML | 49.89accuracy (%) | unverified | 2026-04-17 |
| FrontierMath-Tiers-1-3-v2-Private | 42.81accuracy (%) | reproduced | 2026-04-17 |
| SimpleQA Verified | 38accuracy (%) | reproduced | 2026-04-17 |
| Chess Puzzles | 25accuracy (%) | reproduced | 2026-04-17 |
| FrontierMath-Tier-4-v2-Private | 14.63accuracy (%) | reproduced | 2026-04-17 |
| CritPt | 8accuracy (%) | unverified | 2026-04-17 |