Technology Innovation Institute·released 2024-05-09
Scored on 4 benchmarks. 0% of its scores are independently reproduced — the rest are self-reported or unverified.
Every score, ranked, colored by evidence status.
| Benchmark | Score | Evidence status | Measured |
|---|---|---|---|
| HellaSwag | 77.21accuracy (%) | self-reported· optimized | 2024-05-09 |
| Winogrande | 56.6accuracy (%) | self-reported· optimized | 2024-05-09 |
| GSM8K | 53.83accuracy (%) | self-reported· optimized | 2024-05-09 |
| MMLU | 44.53accuracy (%) | self-reported· optimized | 2024-05-09 |