Qwen·released 2024-09-181 source
Qwen2.5-Coder (7B) benchmark scores: 5 benchmarks tracked. 0% of its scores are independently reproduced — the rest are self-reported or unverified.
Leads on 0 of 5 benchmarks·best result 86.7 on GSM8K (self-reported)·0 of 5 independently reproduced
| Benchmark | Score | Evidence status | Measured |
|---|---|---|---|
| GSM8K | 86.7accuracy (%) | self-reported· optimizedT1 | 2024-09-18Qwen2.5-Coder Technical Report |
| HellaSwag | 69.07accuracy (%) | self-reported· optimizedT1 | 2024-09-18Qwen2.5-Coder Technical Report |
| MMLU | 57.33accuracy (%) | self-reported· optimizedT1 | 2024-09-18Qwen2.5-Coder Technical Report |
| ARC AI2 | 47.87accuracy (%) | self-reported· optimizedT1 | 2024-09-18Qwen2.5-Coder Technical Report |
| Winogrande | 45.8accuracy (%) | self-reported· optimizedT1 | 2024-09-18Qwen2.5-Coder Technical Report |
Claims drawn from cited facts, not live model generation.
This model, developed by Qwen, is a compact 7-billion-parameter release from 2024, pairing lower cost and greater efficiency with diminished headroom relative to frontier-scale models.
3 cited facts
This model is currently scored on five tracked benchmarks, though it holds no top score on any of them. Because these results are self-reported and not yet independently confirmed, treat the numbers as vendor claims rather than verified outcomes.
3 cited facts
With an average gap of 27.04 points below the top benchmark score, this model sits well behind the leaders rather than at the frontier. It holds the top score on none of the tracked benchmarks, so it has no category leadership yet.
2 cited facts
2 facts cross-checked across data sources: 2 single-source.
Source facts, citations, and refresh stamp for this record.
Sources: curated_param_counts, epoch_benchmarks
Qwen2.5-Coder (7B) is an AI model developed by Qwen, released 2024-09-18. Its benchmark record below tags every score as independently reproduced, self-reported, or unverified.
Qwen2.5-Coder (7B) has recorded scores on 5 benchmarks, each shown with its evidence status.
Qwen2.5-Coder (7B) has recorded scores on 5 benchmarks — Winogrande, MMLU, ARC AI2, GSM8K, HellaSwag. The full table above shows each score with its evidence status.
0 of 5 recorded scores (0%) are independently reproduced rather than self-reported by the lab.
Qwen2.5-Coder (7B) has 5 tracked claims: 5 self-reported.