Technology Innovation Institute·released 2023-09-06
Scored on 8 benchmarks, leading 1. 0% of its scores are independently reproduced — the rest are self-reported or unverified.
Leads on: LAMBADA
Every score, ranked, colored by evidence status.
| Benchmark | Score | Evidence status | Measured |
|---|---|---|---|
| HellaSwag | 85.33accuracy (%) | unverified· optimized | 2023-09-06 |
| LAMBADA | 79.8accuracy (%) | unverified· optimized | 2023-09-06 |
| Winogrande | 74.2accuracy (%) | unverified· optimized | 2023-09-06 |
| PIQA | 69.8accuracy (%) | unverified· optimized | 2023-09-06 |
| MMLU | 60.8accuracy (%) | unverified· optimized | 2023-09-06 |
| ARC AI2 | 57.07accuracy (%) | unverified· optimized | 2023-09-06 |
| GSM8K | 54.4accuracy (%) | unverified· optimized | 2023-09-06 |
| OpenBookQA | 52.27accuracy (%) | unverified· optimized | 2023-09-06 |