Anthropic·released 2023-07-111 source
Claude 2 benchmark scores: 6 benchmarks tracked. 50% of its scores are independently reproduced — the rest are self-reported or unverified.
Leads on 0 of 6 benchmarks·best result 87.5 on TriviaQA (self-reported)·3 of 6 independently reproduced
| Benchmark | Score | Evidence status | Measured |
|---|---|---|---|
| TriviaQA | 87.5accuracy (%) | self-reported· optimizedT1 | 2023-07-11Model Card and Evaluations for Claude Models |
| MMLU | 71.33accuracy (%) | self-reported· optimizedT1 | 2023-07-11Model Card and Evaluations for Claude Models |
| DTBench | 19.75accuracy (%) | unverifiedT1 | 2023-07-11https://conceptualreasoning.ai/dtbench |
| GPQA diamond | 12.88accuracy (%) | reproduced· optimizedT1 | 2023-07-11Epoch AI |
| MATH level 5 | 11.73accuracy (%) | reproduced· optimizedT1 | 2023-07-11Epoch AI |
| OTIS Mock AIME 2024-2025 | 2.4accuracy (%) | reproduced· optimizedT1 | 2023-07-11Epoch AI |
Claims drawn from cited facts, not live model generation.
This model was developed by Anthropic and released in 2023, placing it among the earlier entries in that developer's line of assistant models.
2 cited facts
This model is scored on 6 tracked benchmarks, and it currently holds no top score on any of them. Its record has been independently reproduced, meaning outside evaluation backs up the reported scores rather than leaving them as unverified vendor claims.
3 cited facts
Against the best reported scores, this model trails the leader by an average of 59.33 points (sota leader count of 0 top placements), a wide gap under whatever harness produced those numbers — a score gap, not a measure of capability — placing it well behind the front-of-pack.
2 cited facts
1 facts cross-checked across data sources: 1 single-source.
Source facts, citations, and refresh stamp for this record.
Sources: epoch_benchmarks
Claude 2 is an AI model developed by Anthropic, released 2023-07-11. Its benchmark record below tags every score as independently reproduced, self-reported, or unverified.
Claude 2 has recorded scores on 6 benchmarks, each shown with its evidence status.
Claude 2 has recorded scores on 6 benchmarks — GPQA diamond, MATH level 5, OTIS Mock AIME 2024-2025, TriviaQA, DTBench, MMLU. The full table above shows each score with its evidence status.
3 of 6 recorded scores (50%) are independently reproduced rather than self-reported by the lab.
Claude 2 has 6 tracked claims: 3 independently reproduced, 2 self-reported, 1 unverified.