WeirdML
Rank #22 of 51 · 93 models scored · top score 87.85
unknown
Strongest on discrimination, weakest on contamination resistance. Caveat: the public test set leaves contamination on the table.
Weighted composite. Each signal is computed from the source-backed leaderboard below.
Does it still separate models?
How far from ceiling / clustered at the top?
Public vs held-out; training-leak risk.
Apples-to-apples, or mixed / vendor-optimized?
How old is the benchmark?
| # | Model | Score | Evidence | Measured |
|---|---|---|---|---|
| 1 | Claude Fable 5 | 87.85 | unverified | 2026-06-09 |
| 2 | GPT-5.5 | 84.91 | unverified | 2026-04-23 |
| 3 | Claude Opus 4.8 | 82.89 | unverified | 2026-05-28 |
| 4 | GPT-5.3 Codex | 79.3 | unverified | 2026-02-05 |
| 5 | Claude Opus 4.6 | 77.95 | unverified | 2026-02-05 |
| 6 | GPT-5.4 | 77.7 | unverified | 2026-03-05 |
| 7 | Claude Opus 4.7 | 76.4 | unverified | 2026-04-16 |
| 8 | GPT-5.2 | 72.2 | unverified | 2025-12-11 |
| 9 | Gemini 3.1 Pro | 72.1 | unverified | 2026-02-19 |
| 10 | GLM-5.2 | 70.12 | unverified | 2026-06-16 |
| 11 | Gemini 3 Pro | 69.93 | unverified | 2025-11-18 |
| 12 | Claude Sonnet 4.6 | 66.07 | unverified | 2026-02-17 |
| 13 | Claude Opus 4.5 | 63.7 | unverified | 2025-11-24 |
| 14 | Gemini 3.5 Flash | 62.64 | unverified | 2026-05-19 |
| 15 | Gemini 3 Flash | 61.6 | unverified | 2025-12-17 |
| 16 | GPT-5.1 | 60.77 | unverified | 2025-11-13 |
| 17 | GPT-5 | 60.7 | unverified | 2025-08-07 |
| 18 | GPT-5 Pro | 60.39 | unverified | 2025-10-07 |
| 19 | GPT-5.4 Mini | 60.3 | unverified | 2026-03-17 |
| 20 | o3-pro | 58.21 | unverified | 2025-06-10 |
| 21 | GPT-5.4 Pro | 57.44 | unverified | 2026-03-05 |
| 22 | GLM-5.1 | 57.1 | unverified | 2026-04-07 |
| 23 | Kimi K2.6 | 55.86 | unverified | 2026-04-20 |
| 24 | Kimi K2.7 Code | 54.12 | unverified | 2026-06-12 |
| 25 | Gemini 2.5 Pro (Jun 2025) | 54.03 | unverified | 2025-06-05 |
| 26 | GPT-5 mini | 52.67 | unverified | 2025-08-07 |
| 27 | o4-mini | 52.56 | unverified | 2025-04-16 |
| 28 | o3 | 52.42 | unverified | 2024-12-20 |
| 29 | Grok 4.20 | 52.26 | unverified | 2026-02-17 |
| 30 | Gemini 3.1 Flash-Lite | 52.19 | unverified | 2026-03-03 |
| 31 | Grok 4.3 Beta | 49.89 | unverified | 2026-04-17 |
| 32 | GPT-5.4 Nano | 49.23 | unverified | 2026-03-17 |
| 33 | DeepSeek-V4-Pro | 48.9 | unverified | 2026-04-24 |
| 34 | gpt-oss-120b | 48.17 | unverified | 2025-08-05 |
| 35 | GLM-5 | 48.17 | unverified | 2026-02-11 |
| 36 | Claude Sonnet 4.5 | 47.71 | unverified | 2025-09-29 |
| 37 | o1-preview | 47.56 | unverified | 2024-09-12 |
| 38 | Claude Sonnet 4 | 46.11 | unverified | 2025-05-22 |
| 39 | Grok 4 | 45.73 | unverified | 2025-07-09 |
| 40 | Kimi K2.5 | 45.6 | unverified | 2026-02-02 |
| 41 | Claude Haiku 4.5 | 45.4 | unverified | 2025-10-15 |
| 42 | o1 | 43.82 | unverified | 2024-12-05 |
| 43 | o3-mini | 43.7 | unverified | 2025-01-31 |
| 44 | Claude Opus 4 | 43.4 | unverified | 2025-05-22 |
| 45 | Grok 4 Fast | 42.86 | unverified | 2025-09-19 |
| 46 | Kimi K2 Thinking | 42.79 | unverified | 2025-11-06 |
| 47 | Claude Opus 4.1 | 42.76 | unverified | 2025-08-05 |
| 48 | Grok-3 mini | 42.58 | unverified | 2025-02-19 |
| 49 | Gemini 2.5 Flash (Sep 2025) | 41.91 | unverified | 2025-09-25 |
| 50 | DeepSeek-R1 (May 2025) | 41.63 | unverified | 2025-05-28 |
| 51 | Qwen3-235B-A22B-Thinking (Jul 2025) | 41.04 | unverified | 2025-07-25 |
| 52 | Gemini 2.5 Flash (Apr 2025) | 40.95 | unverified | 2025-04-17 |
| 53 | Gemini 2.5 Flash (May 2025) | 40.95 | unverified | 2025-05-20 |
| 54 | Claude 3.5 Sonnet (October 2024) | 39.97 | unverified | 2024-10-22 |
| 55 | DeepSeek-V3.2-Exp | 39.48 | unverified | 2025-09-29 |
| 56 | GPT-4.5 | 39.37 | unverified | 2025-02-27 |
| 57 | Kimi K2 (Jul 2025) | 39.36 | unverified | 2025-07-11 |
| 58 | GPT-4.1 | 39.04 | unverified | 2025-04-14 |
| 59 | Qwen3-235B-A22B-Instruct (Jul 2025) | 38.7 | unverified | 2025-07-25 |
| 60 | DeepSeek-V3.1 | 38.36 | unverified | 2025-08-21 |
| 61 | GPT-5 nano | 38.06 | unverified | 2025-08-07 |
| 62 | GPT-4.1 mini | 37.61 | unverified | 2025-04-14 |
| 63 | Qwen3-235B-A22B | 37.28 | unverified | 2025-04-28 |
| 64 | Grok 3 | 37.24 | unverified | 2025-02-17 |
| 65 | MiniMax-M2.7 | 36.95 | unverified | 2026-03-18 |
| 66 | Kimi K2 (Sep 2025) | 36.68 | unverified | 2025-07-11 |
| 67 | DeepSeek-R1 | 36.49 | unverified | 2025-01-20 |
| 68 | o1-mini | 36.32 | unverified | 2024-09-12 |
| 69 | DeepSeek-V3 (Mar 2025) | 36.08 | unverified | 2025-03-24 |
| 70 | Claude 3.5 Sonnet | 30.97 | unverified | 2024-06-20 |
| 71 | Claude 3.5 Haiku | 30.73 | unverified | 2024-10-22 |
| 72 | Gemini 2.0 Flash (Feb 2025) | 25.77 | unverified | 2024-12-11 |
| 73 | GPT-4o (Nov 2024) | 25.12 | unverified | 2024-05-13 |
| 74 | Gemini 1.5 Flash (Sep 2024) | 24.87 | unverified | 2024-05-10 |
| 75 | Llama 4 Maverick | 24.47 | unverified | 2025-04-05 |
| 76 | Claude 3 Opus | 23.18 | unverified | 2024-03-04 |
| 77 | Grok-2 (Dec 2024) | 22.24 | unverified | 2024-08-13 |
| 78 | Gemini 1.5 Pro (Sept 2024) | 22.2 | unverified | 2024-09-24 |
| 79 | Llama 3.1-405B | 21.38 | unverified | 2024-07-23 |
| 80 | GPT-4.1 nano | 18.98 | unverified | 2025-04-14 |
| 81 | GPT-4 Turbo (Apr 2024) | 18.01 | unverified | 2024-04-09 |
| 82 | Qwen2.5-72B | 15.97 | unverified | 2024-09-19 |
| 83 | Llama 3.3 70B | 14.44 | unverified | 2024-12-06 |
| 84 | GPT-4 (Jun 2023) | 12.44 | unverified | 2023-06-13 |
| 85 | GPT-4o mini | 11.76 | unverified | 2024-07-18 |
| 86 | Qwen2-72B | 11.3 | unverified | 2024-06-07 |
| 87 | Claude 3 Sonnet | 10.16 | unverified | 2024-03-04 |
| 88 | Claude 3 Haiku | 9.84 | unverified | 2024-03-04 |
| 89 | Llama 3.1-70B | 8.97 | unverified | 2024-07-23 |
| 90 | Claude 2.1 | 7.06 | unverified | 2023-11-21 |
| 91 | GPT-3.5 Turbo (Jan 2024) | 3.48 | unverified | 2023-06-13 |
| 92 | Mixtral 8x22B | 3.17 | unverified | 2024-04-17 |
| 93 | Llama 3.1-8B | 1.73 | unverified | 2024-07-23 |