Meta AI·released 2023-07-18
Scored on 11 benchmarks. 0% of its scores are independently reproduced — the rest are self-reported or unverified.
Every score, ranked, colored by evidence status.
| Benchmark | Score | Evidence status | Measured |
|---|---|---|---|
| TriviaQA | 79.6accuracy (%) | unverified· optimized | 2023-07-18 |
| LAMBADA | 76.5accuracy (%) | self-reported· optimized | 2023-07-18 |
| HellaSwag | 74.27accuracy (%) | unverified· optimized | 2023-07-18 |
| PIQA | 61.6accuracy (%) | unverified· optimized | 2023-07-18 |
| ARC AI2 | 47.07accuracy (%) | unverified· optimized | 2023-07-18 |
| Winogrande | 45.6accuracy (%) | unverified· optimized | 2023-07-18 |
| BBH | 44.27accuracy (%) | unverified· optimized | 2023-07-18 |
| OpenBookQA | 42.67accuracy (%) | unverified· optimized | 2023-07-18 |
| ScienceQA | 41.04accuracy (%) | unverified· optimized | 2023-07-18 |
| MMLU | 40.8accuracy (%) | unverified· optimized | 2023-07-18 |
| GSM8K | 36.9accuracy (%) | unverified· optimized | 2023-07-18 |