Qwen·released 2026-05-19
Scored on 10 benchmarks. 70% of its scores are independently reproduced — the rest are self-reported or unverified.
Every score, ranked, colored by evidence status.
| Benchmark | Score | Evidence status | Measured |
|---|---|---|---|
| OTIS Mock AIME 2024-2025 | 94.99accuracy (%) | reproduced· optimized | 2026-05-19 |
| GPQA diamond | 88.8accuracy (%) | reproduced· optimized | 2026-05-19 |
| SWE-Bench verified | 77.27accuracy (%) | reproduced· optimized | 2026-05-19 |
| FrontierMath-Tiers-1-3-v2-Private | 64.56accuracy (%) | reproduced | 2026-05-19 |
| SimpleBench | 64.48accuracy (%) | unverified | 2026-05-19 |
| SimpleQA Verified | 58.52accuracy (%) | reproduced | 2026-05-19 |
| FrontierMath-Tier-4-v2-Private | 34.15accuracy (%) | reproduced | 2026-05-19 |
| Chess Puzzles | 22accuracy (%) | reproduced | 2026-05-19 |
| CritPt | 13.43accuracy (%) | unverified | 2026-05-19 |
| GBAEval | 0.41accuracy (%) | unverified | 2026-05-19 |