SimpleBench
Rank #26 of 51 · 64 models scored · top score 78.28
unknown
Strongest on discrimination, weakest on contamination resistance. Caveat: the public test set leaves contamination on the table.
Weighted composite. Each signal is computed from the source-backed leaderboard below.
Does it still separate models?
How far from ceiling / clustered at the top?
Public vs held-out; training-leak risk.
Apples-to-apples, or mixed / vendor-optimized?
How old is the benchmark?
| # | Model | Score | Evidence | Measured |
|---|---|---|---|---|
| 1 | Claude Fable 5 | 78.28 | unverified | 2026-06-09 |
| 2 | Gemini 3.1 Pro | 75.52 | unverified | 2026-02-19 |
| 3 | GPT-5.5 Pro | 72.28 | unverified | 2026-04-23 |
| 4 | Gemini 3.5 Flash | 72.04 | unverified | 2026-05-19 |
| 5 | Gemini 3 Pro | 71.68 | unverified | 2025-11-18 |
| 6 | GPT-5.4 Pro | 68.92 | unverified | 2026-03-05 |
| 7 | Qwen3.7-Max | 64.48 | unverified | 2026-05-19 |
| 8 | GPT-5.5 | 62.8 | unverified | 2026-04-23 |
| 9 | Claude Opus 4.6 | 61.12 | unverified | 2026-02-05 |
| 10 | Claude Opus 4.8 | 57.76 | unverified | 2026-05-28 |
| 11 | Qwen 3.6 Max (Preview) | 55.6 | unverified | 2026-04-20 |
| 12 | Claude Opus 4.7 | 55.48 | unverified | 2026-04-16 |
| 13 | Gemini 2.5 Pro (Jun 2025) | 54.88 | unverified | 2025-06-05 |
| 14 | Claude Opus 4.5 | 54.4 | unverified | 2025-11-24 |
| 15 | GPT-5 Pro | 53.92 | unverified | 2025-10-07 |
| 16 | DeepSeek-V4-Pro | 53.44 | unverified | 2026-04-24 |
| 17 | Gemini 3 Flash | 53.32 | unverified | 2025-12-17 |
| 18 | Grok 4 | 52.6 | unverified | 2025-07-09 |
| 19 | Claude Opus 4.1 | 52 | unverified | 2025-08-05 |
| 20 | Claude Opus 4 | 50.56 | unverified | 2025-05-22 |
| 21 | GLM-5.1 | 50.44 | unverified | 2026-04-07 |
| 22 | GPT-5.2 Pro | 48.88 | unverified | 2025-12-11 |
| 23 | GPT-5 | 48.04 | unverified | 2025-08-07 |
| 24 | Claude Sonnet 4.5 | 45.16 | unverified | 2025-09-29 |
| 25 | GLM-5 | 43.84 | unverified | 2026-02-11 |
| 26 | GPT-5.1 | 43.84 | unverified | 2025-11-13 |
| 27 | o3 | 43.72 | unverified | 2024-12-20 |
| 28 | Gemini 2.5 Pro (Mar 2025) | 41.92 | unverified | 2025-03-25 |
| 29 | GLM-4.7 | 37.24 | unverified | 2025-12-22 |
| 30 | Kimi K2.5 | 36.16 | unverified | 2026-02-02 |
| 31 | Claude 3.7 Sonnet | 35.68 | unverified | 2025-02-24 |
| 32 | GPT-5.2 | 34.96 | unverified | 2025-12-11 |
| 33 | Claude Sonnet 4 | 34.6 | unverified | 2025-05-22 |
| 34 | o1-preview | 30.04 | unverified | 2024-09-12 |
| 35 | Claude 3.5 Sonnet (October 2024) | 29.68 | unverified | 2024-10-22 |
| 36 | Gemini 2.5 Flash (Jun 2025) | 29.44 | unverified | 2025-06-17 |
| 37 | DeepSeek-R1 (May 2025) | 28.96 | unverified | 2025-05-28 |
| 38 | o1 | 28.12 | unverified | 2024-12-05 |
| 39 | DeepSeek-V3.1 | 28 | unverified | 2025-08-21 |
| 40 | o4-mini | 26.44 | unverified | 2025-04-16 |
| 41 | Grok 3 | 23.32 | unverified | 2025-02-17 |
| 42 | GPT-4.5 | 21.4 | unverified | 2025-02-27 |
| 43 | Gemini 2.0 Flash (Dec 2024) | 17.32 | unverified | 2024-12-11 |
| 44 | Qwen3-235B-A22B | 17.2 | unverified | 2025-04-28 |
| 45 | DeepSeek-R1 | 17.08 | unverified | 2025-01-20 |
| 46 | Gemini 2.0 Flash Thinking (Jan 2025) | 16.84 | unverified | 2025-01-21 |
| 47 | Llama 4 Maverick | 13.24 | unverified | 2025-04-05 |
| 48 | Claude 3.5 Sonnet | 13 | unverified | 2024-06-20 |
| 49 | DeepSeek-V3 (Mar 2025) | 12.64 | unverified | 2025-03-24 |
| 50 | Gemini 1.5 Pro (Sept 2024) | 12.52 | unverified | 2024-09-24 |
| 51 | GPT-4.1 | 12.4 | unverified | 2025-04-14 |
| 52 | Kimi K2 (Jul 2025) | 11.56 | unverified | 2025-07-11 |
| 53 | GPT-4 Turbo (Apr 2024) | 10.12 | unverified | 2024-04-09 |
| 54 | Claude 3 Opus | 8.2 | unverified | 2024-03-04 |
| 55 | Llama 3.1-405B | 7.6 | unverified | 2024-07-23 |
| 56 | o3-mini | 7.36 | unverified | 2025-01-31 |
| 57 | Grok-2 (Dec 2024) | 7.24 | unverified | 2024-08-13 |
| 58 | Mistral Large 2 (Jul 2024) | 7 | unverified | 2024-07-24 |
| 59 | gpt-oss-120b | 6.52 | unverified | 2025-08-05 |
| 60 | Llama 3.3 70B | 3.88 | unverified | 2024-12-06 |
| 61 | DeepSeek-V3 | 2.68 | unverified | 2024-12-24 |
| 62 | o1-mini | 1.72 | unverified | 2024-09-12 |
| 63 | GPT-4o (Aug 2024) | 1.36 | unverified | 2024-05-13 |
| 64 | GPT-4o mini | 0 | unverified | 2024-07-18 |