Zhipu AI·released 2023-06-241 source
chatglm2-6b benchmark scores: 7 benchmarks tracked. 0% of its scores are independently reproduced — the rest are self-reported or unverified.
Leads on 0 of 7 benchmarks·best result 54.3 on LAMBADA (self-reported)·0 of 7 independently reproduced
| Benchmark | Score | Evidence status | Measured |
|---|---|---|---|
| LAMBADA | 54.3accuracy (%) | self-reported· optimizedT1 | 2023-06-24Qwen Technical Report |
| ARC AI2 | 48accuracy (%) | self-reported· optimizedT1 | 2023-06-24Qwen Technical Report |
| HellaSwag | 42.67accuracy (%) | self-reported· optimizedT1 | 2023-06-24Qwen Technical Report |
| PIQA | 39.2accuracy (%) | self-reported· optimizedT1 | 2023-06-24Qwen Technical Report |
| GSM8K | 32.4accuracy (%) | unverified· optimizedT1 | 2023-06-24Baichuan 2: Open Large-scale Language Models |
| MMLU | 30.53accuracy (%) | self-reported· optimizedT1 | 2023-06-24Qwen Technical Report |
| BBH | 11.6accuracy (%) | unverified· optimizedT1 | 2023-06-24Baichuan 2: Open Large-scale Language Models |
Claims drawn from cited facts, not live model generation.
This model was developed by Zhipu AI and released in 2023. With 6 billion parameters, it is a mid-size model, balancing cost efficiency with more headroom than a compact model.
3 cited facts
This model is scored on 7 tracked benchmarks and currently holds no top score in any of them. Because the results are self-reported and not yet independently confirmed, these numbers should be read as claims rather than verified results.
3 cited facts
With an average gap of 49.91 points below the benchmark leader, this model sits well behind the front of the pack. It holds the top score on none of the tracked benchmarks, so there is no category leadership yet.
2 cited facts
2 facts cross-checked across data sources: 2 single-source.
Source facts, citations, and refresh stamp for this record.
Sources: curated_param_counts, epoch_benchmarks
chatglm2-6b is an AI model developed by Zhipu AI, released 2023-06-24. Its benchmark record below tags every score as independently reproduced, self-reported, or unverified.
chatglm2-6b has recorded scores on 7 benchmarks, each shown with its evidence status.
chatglm2-6b has recorded scores on 7 benchmarks — PIQA, MMLU, ARC AI2, BBH, GSM8K, HellaSwag, and 1 more. The full table above shows each score with its evidence status.
0 of 7 recorded scores (0%) are independently reproduced rather than self-reported by the lab.
chatglm2-6b has 7 tracked claims: 5 self-reported, 2 unverified.