Massive Multitask Language Understanding
Rank #44 of 51 · 98 models scored · top score 84.13
Knowledge breadth across 57 subjects via MC
Strongest on discrimination, weakest on contamination resistance. Caveat: scores come from mixed harnesses, so a head-to-head is not apples-to-apples.
Weighted composite. Each signal is computed from the source-backed leaderboard below.
Does it still separate models?
How far from ceiling / clustered at the top?
Public vs held-out; training-leak risk.
Apples-to-apples, or mixed / vendor-optimized?
How old is the benchmark?
| # | Model | Score | Evidence | Measured |
|---|---|---|---|---|
| 1 | GPT-4o (Nov 2024) | 84.13 | self-reported· optimized | 2024-05-13 |
| 2 | Claude 3.5 Sonnet (October 2024) | 83.07 | unverified· optimized | 2024-10-22 |
| 3 | DeepSeek-V3 | 82.93 | unverified· optimized | 2024-12-24 |
| 4 | Gemini 1.5 Pro (Sept 2024) | 82.53 | unverified· optimized | 2024-09-24 |
| 5 | Claude 3.5 Sonnet | 82 | unverified· optimized | 2024-06-20 |
| 6 | GPT-4 (Mar 2023) | 81.87 | self-reported· optimized | 2023-03-15 |
| 7 | Llama 3.3 70B | 81.73 | unverified· optimized | 2024-12-06 |
| 8 | Gemini 1.5 Pro (May 2024) | 81.2 | unverified· optimized | 2024-05-14 |
| 9 | Qwen2.5-72B | 80.4 | self-reported· optimized | 2024-09-19 |
| 10 | Phi-4 | 79.73 | self-reported· optimized | 2024-12-12 |
| 11 | Claude 3 Opus | 79.47 | unverified· optimized | 2024-03-04 |
| 12 | Llama 3.1-405B | 79.33 | unverified· optimized | 2024-07-23 |
| 13 | GPT-4o (Aug 2024) | 79.07 | unverified· optimized | 2024-05-13 |
| 14 | GPT-4o (May 2024) | 78.93 | unverified· optimized | 2024-05-13 |
| 15 | Qwen2-72B | 76.53 | unverified· optimized | 2024-06-07 |
| 16 | GPT-4 (Jun 2023) | 76.53 | unverified· optimized | 2023-06-13 |
| 17 | Amazon Nova Pro | 76 | unverified· optimized | 2024-12-03 |
| 18 | GPT-4o mini | 75.73 | self-reported· optimized | 2024-07-18 |
| 19 | GPT-4 Turbo (Apr 2024) | 75.07 | unverified· optimized | 2024-04-09 |
| 20 | Llama 3.2 90B | 73.73 | unverified· optimized | 2024-09-24 |
| 21 | Llama 3.1-70B | 73.47 | unverified· optimized | 2024-07-23 |
| 22 | Mistral Large 2 (Jul 2024) | 73.33 | unverified· optimized | 2024-07-24 |
| 23 | Gemini 2.0 Flash (Dec 2024) | 72.93 | unverified· optimized | 2024-12-11 |
| 24 | Llama 3-70B | 72.4 | unverified· optimized | 2024-04-18 |
| 25 | Qwen2.5-Coder-32B | 72.13 | self-reported· optimized | 2024-09-18 |
| 26 | Claude 2 | 71.33 | self-reported· optimized | 2023-07-11 |
| 27 | DeepSeek-V2 (MoE-236B, May 2024) | 71.2 | self-reported· optimized | 2024-05-07 |
| 28 | phi-3-medium 14B | 70.67 | unverified· optimized | 2024-04-23 |
| 29 | Gemini 1.5 Flash (May 2024) | 70.53 | unverified· optimized | 2024-05-10 |
| 30 | Mixtral 8x22B | 70.4 | unverified· optimized | 2024-04-17 |
| 31 | Yi-34B | 68.4 | unverified· optimized | 2023-11-02 |
| 32 | Claude 3 Sonnet | 67.87 | unverified· optimized | 2024-03-04 |
| 33 | Gemma 2 27B | 67.6 | unverified· optimized | 2024-06-24 |
| 34 | phi-3-small 7.4B | 67.6 | self-reported· optimized | 2024-04-23 |
| 35 | Qwen2.5-Coder-14B | 66.93 | self-reported· optimized | 2024-09-18 |
| 36 | Claude 3.5 Haiku | 65.73 | unverified· optimized | 2024-10-22 |
| 37 | Gemini 1.5 Flash (Sep 2024) | 65.2 | unverified· optimized | 2024-05-10 |
| 38 | Claude 3 Haiku | 65.07 | unverified· optimized | 2024-03-04 |
| 39 | Claude 2.1 | 64.67 | unverified· optimized | 2023-11-21 |
| 40 | Claude Instant | 64.53 | self-reported· optimized | 2023-08-09 |
| 41 | Gemma 2 9B | 62.8 | unverified· optimized | 2024-06-24 |
| 42 | GPT-3.5 Turbo (Nov 2023) | 61.87 | self-reported· optimized | 2023-06-13 |
| 43 | Mixtral 8x7B | 60.8 | unverified· optimized | 2023-12-11 |
| 44 | Falcon-180B | 60.8 | unverified· optimized | 2023-09-06 |
| 45 | Gemini 1.0 Pro | 60 | unverified· optimized | 2023-12-06 |
| 46 | Llama 2-70B | 59.87 | unverified· optimized | 2023-07-18 |
| 47 | GPT-3.5 Turbo (Jun 2023) | 58.53 | unverified· optimized | 2023-06-13 |
| 48 | Llama 3-8B | 58.4 | unverified· optimized | 2024-04-18 |
| 49 | Mistral Large | 58.4 | unverified· optimized | 2024-02-26 |
| 50 | phi-3-mini 3.8B | 58.4 | self-reported· optimized | 2024-04-23 |
| 51 | Stable Beluga 2 | 58.13 | self-reported· optimized | 2023-07-20 |
| 52 | Yi-9B | 57.87 | unverified· optimized | 2024-03-01 |
| 53 | Qwen2.5-Coder (7B) | 57.33 | self-reported· optimized | 2024-09-18 |
| 54 | GPT-3.5 Turbo (Jan 2024) | 56.4 | unverified· optimized | 2023-06-13 |
| 55 | Qwen-14B | 55.07 | self-reported· optimized | 2023-09-24 |
| 56 | Gemma 7B | 54.8 | unverified· optimized | 2024-02-21 |
| 57 | StarCoder 2 15B | 52.13 | self-reported· optimized | 2024-02-29 |
| 58 | Yi 6B | 52 | unverified· optimized | 2023-11-02 |
| 59 | LLaMA-65B | 51.2 | unverified· optimized | 2023-02-24 |
| 60 | Llama 2-34B | 50.13 | unverified· optimized | 2023-07-18 |
| 61 | Mistral 7B v0.1 | 50 | unverified· optimized | 2023-10-10 |
| 62 | DeepSeek-Coder-V2-Lite-Base | 47.33 | self-reported· optimized | 2024-06-13 |
| 63 | Baichuan2-13B | 45.6 | unverified· optimized | 2023-09-06 |
| 64 | LLaMA-33B | 44.93 | unverified· optimized | 2023-02-27 |
| 65 | Nemotron-4 15B | 44.93 | self-reported· optimized | 2024-02-27 |
| 66 | Phi-2 | 44.53 | unverified· optimized | 2023-12-12 |
| 67 | Falcon 2 11B | 44.53 | self-reported· optimized | 2024-05-09 |
| 68 | Falcon-40B | 42.53 | self-reported· optimized | 2023-03-15 |
| 69 | Llama 3.1-8B | 41.47 | unverified· optimized | 2024-07-23 |
| 70 | Llama 2-13B | 40.8 | unverified· optimized | 2023-07-18 |
| 71 | Baichuan 2-7B | 38.88 | unverified· optimized | 2023-09-20 |
| 72 | Qwen2.5-Coder (1.5B) | 38.13 | self-reported· optimized | 2024-09-18 |
| 73 | internlm-7b | 34.67 | self-reported· optimized | 2023-07-05 |
| 74 | INTELLECT-1 | 33.19 | self-reported· optimized | 2024-11-29 |
| 75 | MPT-30B | 30.53 | self-reported· optimized | 2023-06-22 |
| 76 | chatglm2-6b | 30.53 | self-reported· optimized | 2023-06-24 |
| 77 | LLaMA-13B | 30.27 | unverified· optimized | 2023-02-27 |
| 78 | Llama 2-7B | 27.73 | unverified· optimized | 2023-07-18 |
| 79 | Qwen-7B | 26.67 | self-reported· optimized | 2023-09-28 |
| 80 | Gemma 2B | 23.07 | unverified· optimized | 2024-02-21 |
| 81 | Baichuan1-7B | 23.07 | unverified· optimized | 2023-06-01 |
| 82 | Qwen2.5-Coder-0.5B | 22.67 | self-reported· optimized | 2024-09-18 |
| 83 | CodeQwen1.5-7B | 20.67 | self-reported· optimized | 2024-04-15 |
| 84 | DeepSeek Coder 33B | 19.2 | self-reported· optimized | 2024-01-25 |
| 85 | StarCoder 2 7B | 18.4 | self-reported· optimized | 2024-02-29 |
| 86 | Phi-1.5 | 16.8 | self-reported· optimized | 2023-09-11 |
| 87 | StarCoder 2 3B | 15.47 | self-reported· optimized | 2024-02-29 |
| 88 | DeepSeek Coder 6.7B | 15.2 | self-reported· optimized | 2024-01-25 |
| 89 | XGen-7B | 15.07 | self-reported· optimized | 2023-09-07 |
| 90 | LLaMA-7B | 14.13 | unverified· optimized | 2023-02-24 |
| 91 | Falcon-7B | 13.33 | self-reported· optimized | 2023-04-24 |
| 92 | MPT-7B | 7.73 | self-reported· optimized | 2023-05-05 |
| 93 | open_llama_7b | 6.53 | self-reported· optimized | 2023-06-07 |
| 94 | Qwen-1_8B | 4.27 | self-reported· optimized | 2023-11-30 |
| 95 | RedPajama-INCITE-7B-Base | 1.73 | self-reported· optimized | 2023-05-04 |
| 96 | Dolly 2.0-12b | 1.6 | self-reported· optimized | 2023-04-12 |
| 97 | Cerebras-GPT-13B | 1.6 | self-reported· optimized | 2023-04-06 |
| 98 | DeepSeek Coder 1.3B | 1.07 | self-reported· optimized | 2024-01-25 |