Qwen·released 2024-04-151 source
CodeQwen1.5-7B benchmark scores: 4 benchmarks tracked. 0% of its scores are independently reproduced — the rest are self-reported or unverified.
Leads on 0 of 4 benchmarks·best result 37.7 on GSM8K (self-reported)·0 of 4 independently reproduced
| Benchmark | Score | Evidence status | Measured |
|---|---|---|---|
| GSM8K | 37.7accuracy (%) | self-reported· optimizedT1 | 2024-04-15Qwen2.5-Coder Technical Report |
| MMLU | 20.67accuracy (%) | self-reported· optimizedT1 | 2024-04-15Qwen2.5-Coder Technical Report |
| Winogrande | 19.6accuracy (%) | self-reported· optimizedT1 | 2024-04-15Qwen2.5-Coder Technical Report |
| ARC AI2 | 14.27accuracy (%) | self-reported· optimizedT1 | 2024-04-15Qwen2.5-Coder Technical Report |
Claims drawn from cited facts, not live model generation.
Across its tracked benchmarks, this model is scored on four, but it currently holds no top score in any of them. Because these results are self-reported and have not yet been independently confirmed, the numbers should be read as claims rather than verified results.
3 cited facts
This model trails the leading score by an average of 64 points, a wide gap that places it well behind the front-runners. It holds the top score on none of the tracked benchmarks, meaning it has not established category leadership on any of them.
2 cited facts
2 facts cross-checked across data sources: 2 single-source.
Source facts, citations, and refresh stamp for this record.
Sources: curated_param_counts, epoch_benchmarks
CodeQwen1.5-7B is an AI model developed by Qwen, released 2024-04-15. Its benchmark record below tags every score as independently reproduced, self-reported, or unverified.
CodeQwen1.5-7B has recorded scores on 4 benchmarks, each shown with its evidence status.
CodeQwen1.5-7B has recorded scores on 4 benchmarks — Winogrande, MMLU, ARC AI2, GSM8K. The full table above shows each score with its evidence status.
0 of 4 recorded scores (0%) are independently reproduced rather than self-reported by the lab.
CodeQwen1.5-7B has 4 tracked claims: 4 self-reported.