Zhipu AI·released 2026-04-07
Scored on 12 benchmarks. 58% of its scores are independently reproduced — the rest are self-reported or unverified.
Every score, ranked, colored by evidence status.
| Benchmark | Score | Evidence status | Measured |
|---|---|---|---|
| OTIS Mock AIME 2024-2025 | 92.21accuracy (%) | reproduced· optimized | 2026-04-07 |
| GPQA diamond | 80.64accuracy (%) | reproduced· optimized | 2026-04-07 |
| SWE-Bench verified | 74.17accuracy (%) | reproduced· optimized | 2026-04-07 |
| FrontierMath-2025-02-28-Private | 58.68accuracy (%) | reproduced· optimized | 2026-04-07 |
| WeirdML | 57.1accuracy (%) | unverified | 2026-04-07 |
| SimpleBench | 50.44accuracy (%) | unverified | 2026-04-07 |
| SimpleQA Verified | 37.29accuracy (%) | reproduced | 2026-04-07 |
| FrontierMath-Tier-4-2025-07-01-Private | 20.83accuracy (%) | reproduced | 2026-04-07 |
| Chess Puzzles | 18accuracy (%) | reproduced | 2026-04-07 |
| ExploitBench | 18accuracy (%) | unverified | 2026-04-07 |
| CritPt | 4.57accuracy (%) | unverified | 2026-04-07 |
| GBAEval | 0accuracy (%) | unverified | 2026-04-07 |