Databricks·released 2023-04-121 source
Dolly 2.0-12b benchmark scores: 6 benchmarks tracked. 0% of its scores are independently reproduced — the rest are self-reported or unverified.
Leads on 0 of 6 benchmarks·best result 61.07 on HellaSwag (self-reported)·0 of 6 independently reproduced
| Benchmark | Score | Evidence status | Measured |
|---|---|---|---|
| HellaSwag | 61.07accuracy (%) | self-reported· optimizedT1 | 2023-04-12XGen-7B Technical Report |
| PIQA | 50.8accuracy (%) | self-reported· optimizedT1 | 2023-04-12XGen-7B Technical Report |
| Winogrande | 23.6accuracy (%) | self-reported· optimizedT1 | 2023-04-12XGen-7B Technical Report |
| ARC AI2 | 19.47accuracy (%) | self-reported· optimizedT1 | 2023-04-12XGen-7B Technical Report |
| OpenBookQA | 18.93accuracy (%) | self-reported· optimizedT1 | 2023-04-12XGen-7B Technical Report |
| MMLU | 1.6accuracy (%) | self-reported· optimizedT1 | 2023-04-12XGen-7B Technical Report |
Claims drawn from cited facts, not live model generation.
This model was developed by Databricks and released in 2023.
2 cited facts
This model is scored on 6 tracked benchmarks but holds no current top score; because the record is self-reported, these numbers should be regarded as claims rather than independently verified results.
3 cited facts
Trailing the leader by an average of 56.27 points and holding top score on zero benchmarks, the model sits well behind the leaders.
2 cited facts
1 facts cross-checked across data sources: 1 single-source.
Source facts, citations, and refresh stamp for this record.
Sources: epoch_benchmarks
Dolly 2.0-12b is an AI model developed by Databricks, released 2023-04-12. Its benchmark record below tags every score as independently reproduced, self-reported, or unverified.
Dolly 2.0-12b has recorded scores on 6 benchmarks, each shown with its evidence status.
Dolly 2.0-12b has recorded scores on 6 benchmarks — PIQA, OpenBookQA, Winogrande, MMLU, ARC AI2, HellaSwag. The full table above shows each score with its evidence status.
0 of 6 recorded scores (0%) are independently reproduced rather than self-reported by the lab.
Dolly 2.0-12b has 6 tracked claims: 6 self-reported.