DeepSeek·released 2023-11-021 source
DeepSeek Coder 6.7B benchmark scores: 4 benchmarks tracked. 0% of its scores are independently reproduced — the rest are self-reported or unverified.
Leads on 0 of 4 benchmarks·best result 21.3 on GSM8K (self-reported)·0 of 4 independently reproduced
| Benchmark | Score | Evidence status | Measured |
|---|---|---|---|
| GSM8K | 21.3accuracy (%) | self-reported· optimizedT1 | 2023-11-02Qwen2.5-Coder Technical Report |
| Winogrande | 15.2accuracy (%) | self-reported· optimizedT1 | 2023-11-02Qwen2.5-Coder Technical Report |
| MMLU | 15.2accuracy (%) | self-reported· optimizedT1 | 2023-11-02Qwen2.5-Coder Technical Report |
| ARC AI2 | 15.2accuracy (%) | self-reported· optimizedT1 | 2023-11-02Qwen2.5-Coder Technical Report |
Claims drawn from cited facts, not live model generation.
Developed by DeepSeek, this model is a compact 6.7-billion-parameter release from 2023. This compact scale emphasizes efficiency and lower cost over the extra headroom and expense of larger models.
4 cited facts
This model is tracked across four benchmarks, though it currently holds no top score on any of them. These figures are self-reported and not yet independently confirmed, so they should be read as claims rather than verified results.
3 cited facts
With an average score gap of 70.34 points behind the leader, this model sits well behind the front of the pack on its benchmarks. It holds the top score on none of the tracked benchmarks, so it shows no category leadership yet.
2 cited facts
2 facts cross-checked across data sources: 2 single-source.
Source facts, citations, and refresh stamp for this record.
Sources: curated_param_counts, epoch_benchmarks
DeepSeek Coder 6.7B is an AI model developed by DeepSeek, released 2023-11-02. Its benchmark record below tags every score as independently reproduced, self-reported, or unverified.
DeepSeek Coder 6.7B has recorded scores on 4 benchmarks, each shown with its evidence status.
DeepSeek Coder 6.7B has recorded scores on 4 benchmarks — Winogrande, MMLU, ARC AI2, GSM8K. The full table above shows each score with its evidence status.
0 of 4 recorded scores (0%) are independently reproduced rather than self-reported by the lab.
DeepSeek Coder 6.7B has 4 tracked claims: 4 self-reported.