Qwen·released 2025-07-25
Scored on 9 benchmarks. 67% of its scores are independently reproduced — the rest are self-reported or unverified.
Every score, ranked, colored by evidence status.
| Benchmark | Score | Evidence status | Measured |
|---|---|---|---|
| OTIS Mock AIME 2024-2025 | 86.65accuracy (%) | reproduced· optimized | 2025-07-25 |
| Lech Mazur Writing | 84.95accuracy (%) | unverified | 2025-07-25 |
| Fiction.LiveBench | 75accuracy (%) | unverified | 2025-07-25 |
| GPQA diamond | 73.4accuracy (%) | reproduced· optimized | 2025-07-25 |
| SimpleQA Verified | 50.1accuracy (%) | reproduced | 2025-07-25 |
| WeirdML | 41.04accuracy (%) | unverified | 2025-07-25 |
| FrontierMath-2025-02-28-Private | 14.88accuracy (%) | reproduced· optimized | 2025-07-25 |
| Chess Puzzles | 12accuracy (%) | reproduced | 2025-07-25 |
| FrontierMath-Tier-4-2025-07-01-Private | 0accuracy (%) | reproduced | 2025-07-25 |