Mistral AI·released 2025-05-07
Scored on 5 benchmarks. 80% of its scores are independently reproduced — the rest are self-reported or unverified.
Every score, ranked, colored by evidence status.
| Benchmark | Score | Evidence status | Measured |
|---|---|---|---|
| MATH level 5 | 81.63accuracy (%) | reproduced· optimized | 2025-05-07 |
| GPQA diamond | 46.04accuracy (%) | reproduced· optimized | 2025-05-07 |
| OTIS Mock AIME 2024-2025 | 32.15accuracy (%) | reproduced· optimized | 2025-05-07 |
| FrontierMath-2025-02-28-Private | 0.61accuracy (%) | reproduced· optimized | 2025-05-07 |
| HLE | 0accuracy (%) | unverified | 2025-05-07 |