Aider polyglot
Rank #23 of 51 · 44 models scored · top score 88
unknown
Strongest on discrimination, weakest on contamination resistance. Caveat: the public test set leaves contamination on the table.
Weighted composite. Each signal is computed from the source-backed leaderboard below.
Does it still separate models?
How far from ceiling / clustered at the top?
Public vs held-out; training-leak risk.
Apples-to-apples, or mixed / vendor-optimized?
How old is the benchmark?
| # | Model | Score | Evidence | Measured |
|---|---|---|---|---|
| 1 | GPT-5 | 88 | unverified· optimized | 2025-08-07 |
| 2 | o3-pro | 84.9 | unverified· optimized | 2025-06-10 |
| 3 | Gemini 2.5 Pro (Jun 2025) | 83.1 | unverified· optimized | 2025-06-05 |
| 4 | o3 | 81.3 | unverified· optimized | 2024-12-20 |
| 5 | Grok 4 | 79.6 | unverified· optimized | 2025-07-09 |
| 6 | Gemini 2.5 Pro (May 2025) | 76.9 | unverified· optimized | 2025-05-06 |
| 7 | DeepSeek-V3.2 | 74.2 | unverified· optimized | 2025-12-01 |
| 8 | DeepSeek-V3.2-Exp | 74.2 | unverified· optimized | 2025-09-29 |
| 9 | Gemini 2.5 Pro (Mar 2025) | 72.9 | unverified· optimized | 2025-03-25 |
| 10 | Claude Opus 4 | 72 | unverified· optimized | 2025-05-22 |
| 11 | o4-mini | 72 | unverified· optimized | 2025-04-16 |
| 12 | DeepSeek-R1 (May 2025) | 71.4 | unverified· optimized | 2025-05-28 |
| 13 | Claude 3.7 Sonnet | 64.9 | unverified· optimized | 2025-02-24 |
| 14 | o1 | 61.7 | unverified· optimized | 2024-12-05 |
| 15 | Claude Sonnet 4 | 61.3 | unverified· optimized | 2025-05-22 |
| 16 | o3-mini | 60.4 | unverified· optimized | 2025-01-31 |
| 17 | Qwen3-235B-A22B | 59.6 | unverified· optimized | 2025-04-28 |
| 18 | Qwen3-235B-A22B-Instruct (Jul 2025) | 59.6 | unverified· optimized | 2025-07-25 |
| 19 | Kimi K2 (Jul 2025) | 59.1 | unverified· optimized | 2025-07-11 |
| 20 | Kimi K2 (Sep 2025) | 59.1 | unverified· optimized | 2025-07-11 |
| 21 | DeepSeek-R1 | 56.9 | unverified· optimized | 2025-01-20 |
| 22 | DeepSeek-V3 (Mar 2025) | 55.1 | unverified· optimized | 2025-03-24 |
| 23 | Gemini 2.5 Flash (May 2025) | 55.1 | unverified· optimized | 2025-05-20 |
| 24 | Grok 3 | 53.3 | unverified· optimized | 2025-02-17 |
| 25 | GPT-4.1 | 52.4 | unverified· optimized | 2025-04-14 |
| 26 | Claude 3.5 Sonnet (October 2024) | 51.6 | unverified· optimized | 2024-10-22 |
| 27 | Grok-3 mini | 49.3 | unverified· optimized | 2025-02-19 |
| 28 | DeepSeek-V3 | 48.4 | unverified· optimized | 2024-12-24 |
| 29 | Gemini 2.5 Flash (Apr 2025) | 47.1 | unverified· optimized | 2025-04-17 |
| 30 | GPT-4.5 | 44.9 | unverified· optimized | 2025-02-27 |
| 31 | gpt-oss-120b | 41.8 | unverified· optimized | 2025-08-05 |
| 32 | Gemini 2.0 Flash (Dec 2024) | 38.2 | unverified· optimized | 2024-12-11 |
| 33 | Gemini 2.0 Pro | 35.6 | unverified· optimized | 2024-12-11 |
| 34 | o1-mini | 32.9 | unverified· optimized | 2024-09-12 |
| 35 | GPT-4.1 mini | 32.4 | unverified· optimized | 2025-04-14 |
| 36 | Claude 3.5 Haiku | 28 | unverified· optimized | 2024-10-22 |
| 37 | GPT-4o (Aug 2024) | 23.1 | unverified· optimized | 2024-05-13 |
| 38 | Qwen2.5-Max | 21.8 | unverified· optimized | 2025-01-25 |
| 39 | GPT-4o (Nov 2024) | 18.2 | unverified· optimized | 2024-05-13 |
| 40 | Gemini 2.0 Flash Thinking (Jan 2025) | 18.2 | unverified· optimized | 2025-01-21 |
| 41 | Llama 4 Maverick | 15.6 | unverified· optimized | 2025-04-05 |
| 42 | GPT-4.1 nano | 8.9 | unverified· optimized | 2025-04-14 |
| 43 | Gemma 3 27B | 4.9 | unverified· optimized | 2025-03-12 |
| 44 | GPT-4o mini | 3.6 | unverified· optimized | 2024-07-18 |