Zhipu AI·released 2026-02-11
Scored on 14 benchmarks. 43% of its scores are independently reproduced — the rest are self-reported or unverified.
Every score, ranked, colored by evidence status.
| Benchmark | Score | Evidence status | Measured |
|---|---|---|---|
| GPQA diamond | 83.76accuracy (%) | reproduced· optimized | 2026-02-11 |
| OTIS Mock AIME 2024-2025 | 79.98accuracy (%) | reproduced· optimized | 2026-02-11 |
| SWE-Bench verified | 72.08accuracy (%) | reproduced· optimized | 2026-02-11 |
| Terminal Bench | 52.4accuracy (%) | unverified· optimized | 2026-02-11 |
| WeirdML | 48.17accuracy (%) | unverified | 2026-02-11 |
| ARC-AGI | 44.67accuracy (%) | unverified· optimized | 2026-02-11 |
| SimpleBench | 43.84accuracy (%) | unverified | 2026-02-11 |
| FrontierMath-2025-02-28-Private | 28.83accuracy (%) | reproduced· optimized | 2026-02-11 |
| CL-bench | 18.7accuracy (%) | unverified | 2026-02-11 |
| APEX-Agents | 17.2accuracy (%) | unverified | 2026-02-11 |
| PostTrainBench | 13.88accuracy (%) | unverified | 2026-02-11 |
| Chess Puzzles | 10accuracy (%) | reproduced | 2026-02-11 |
| ARC-AGI-2 | 4.86accuracy (%) | unverified | 2026-02-11 |
| FrontierMath-Tier-4-2025-07-01-Private | 3.5accuracy (%) | reproduced | 2026-02-11 |