OpenAI·released 2025-04-161 source
o4-mini benchmark scores: 24 benchmarks tracked. 17% of its scores are independently reproduced — the rest are self-reported or unverified.
Leads on 0 of 24 benchmarks·best result 97.83 on MATH level 5 (reproduced)·4 of 24 independently reproduced·$1.1/$4.4 per M tokens
Consensus: LiteLLM · Cross-check: models.dev, OpenRouter · See every model’s pricing →
| Benchmark | Score | Evidence status | Measured |
|---|---|---|---|
| MATH level 5 | 97.83accuracy (%) | reproduced· optimizedT1 | 2025-04-16Epoch AI |
| OTIS Mock AIME 2024-2025 | 81.65accuracy (%) | reproduced· optimizedT1 | 2025-04-16Epoch AI |
| Fiction.LiveBench | 77.8accuracy (%) | unverifiedT1 | 2025-04-16Fiction.live leaderboard |
| Lech Mazur Writing | 75accuracy (%) | unverifiedT1 | 2025-04-16lechmazur/writing Github repository |
| GPQA diamond | 72.81accuracy (%) | reproduced· optimizedT1 | 2025-04-16Epoch AI |
| Aider polyglot | 72accuracy (%) | unverified· optimizedT1 | 2025-04-16https://aider.chat/docs/leaderboards/ |
| GeoBench | 64accuracy (%) | unverifiedT1 | 2025-04-16GeoBench leaderboard |
| METR Time Horizons | 63.93accuracy (%) | unverifiedT1 | 2025-04-16METR - Measuring AI Ability to Complete Long Tasks |
| DTBench | 62.67accuracy (%) | unverifiedT1 | 2025-04-16https://conceptualreasoning.ai/dtbench |
| CadEval | 62accuracy (%) | unverifiedT1 | 2025-04-16CadEval Dashboard |
| ARC-AGI | 58.67accuracy (%) | unverified· optimizedT1 | 2025-04-16https://arcprize.org/leaderboard |
| WeirdML | 52.56accuracy (%) | unverifiedT1 | 2025-04-16https://htihle.github.io/weirdml.html |
| VPCT | 36.25accuracy (%) | unverifiedT1 | 2025-04-16VPCT leaderboard |
| FrontierMath-Tiers-1-3-v2-Private | 36.14accuracy (%) | unverifiedT2 | 2025-04-16 |
| LMCA | 31.18accuracy (%) | unverifiedT1 | 2025-04-16https://conceptualreasoning.ai/lmca |
| SimpleBench | 26.44accuracy (%) | unverifiedT1 | 2025-04-16SimpleBench Leaderboard |
| GDPval | 25.3accuracy (%) | unverifiedT2 | 2025-04-16 |
| SimpleQA Verified | 19.6accuracy (%) | unverifiedT2 | 2025-04-16 |
| Chess Puzzles | 17.93accuracy (%) | unverifiedT2 | 2025-04-16 |
| HLE | 13.95accuracy (%) | unverifiedT2 | 2025-04-16 |
| ARC-AGI-2 | 6.11accuracy (%) | unverifiedT2 | 2025-04-16 |
| FrontierMath-Tier-4-v2-Private | 4.88accuracy (%) | reproducedT1 | 2025-04-16Epoch AI |
| GSO-Bench | 3.6accuracy (%) | unverifiedT1 | 2025-04-16GSO Leaderboard |
| Mystery Game Puzzles | 0accuracy (%) | unverifiedT2 | 2025-04-16 |
Claims drawn from cited facts, not live model generation.
This model was developed by OpenAI and released in 2025.
2 cited facts
This model has scores on 24 tracked benchmarks and currently leads 0 of them. The record’s evidence status is independently reproduced.
3 cited facts
Its mean gap to the best recorded score across its tracked benchmarks is 41.19 points.
1 cited fact
6 facts cross-checked across data sources: 3 corroborated, 1 single-source, 2 disputed.
Source facts, citations, and refresh stamp for this record.
Sources: epoch_benchmarks, litellm_prices, modelsdev_models, openrouter_models
o4-mini is an AI model developed by OpenAI, released 2025-04-16. Its benchmark record below tags every score as independently reproduced, self-reported, or unverified.
o4-mini has recorded scores on 24 benchmarks, each shown with its evidence status.
o4-mini has recorded scores on 24 benchmarks — Lech Mazur Writing, GPQA diamond, MATH level 5, OTIS Mock AIME 2024-2025, DTBench, WeirdML, and 18 more. The full table above shows each score with its evidence status.
4 of 24 recorded scores (17%) are independently reproduced rather than self-reported by the lab.
o4-mini has 24 tracked claims: 4 independently reproduced, 20 unverified.
Listed API pricing: $1.1 per million input tokens, $4.4 per million output tokens. See the pricing block for the full breakdown.