OpenAI·released 2024-11-201 source
GPT-4o (Nov 2024) benchmark scores: 18 benchmarks tracked, leading 1. 28% of its scores are independently reproduced — the rest are self-reported or unverified.
Leads on 1 of 18 benchmarks·best result 84.13 on MMLU (self-reported)·5 of 18 independently reproduced
Head-to-headGPT-4o (Nov 2024) vs Claude 3.5 Sonnet (October 2024)Leads on: MMLU
| Benchmark | Score | Evidence status | Measured |
|---|---|---|---|
| MMLU | 84.13accuracy (%) | self-reported· optimizedT1 | 2024-11-20Phi-4 Technical Report |
| Lech Mazur Writing | 81.8accuracy (%) | unverifiedT1 | 2024-11-20lechmazur/writing Github repository |
| GeoBench | 71accuracy (%) | unverifiedT1 | 2024-11-20GeoBench leaderboard |
| MATH level 5 | 49.77accuracy (%) | reproduced· optimizedT1 | 2024-11-20Epoch AI |
| SWE-Bench verified | 30.99accuracy (%) | reproduced· optimizedT1 | 2024-11-20Epoch AI |
| GPQA diamond | 30.51accuracy (%) | reproduced· optimizedT1 | 2024-11-20Epoch AI |
| WeirdML | 25.12accuracy (%) | unverifiedT1 | 2024-11-20https://htihle.github.io/weirdml.html |
| Aider polyglot | 18.2accuracy (%) | unverified· optimizedT1 | 2024-11-20https://aider.chat/docs/leaderboards/ |
| Cybench | 12.5accuracy (%) | unverified· optimizedT1 | 2024-11-20Cybench leaderboard |
| VPCT | 10accuracy (%) | unverifiedT1 | 2024-11-20VPCT leaderboard |
| GDPval | 9.9accuracy (%) | unverifiedT2 | 2024-11-20 |
| The Agent Company | 8.6accuracy (%) | unverifiedT1 | 2024-11-20TheAgentCompany experiment results github |
| OTIS Mock AIME 2024-2025 | 6.16accuracy (%) | reproduced· optimizedT1 | 2024-11-20Epoch AI |
| ARC-AGI | 4.5accuracy (%) | unverified· optimizedT1 | 2024-11-20ARC Prize Leaderboard |
| FrontierMath-2025-02-28-Private | 0.6accuracy (%) | reproduced· optimizedT1 | 2024-11-20Epoch AI |
| GSO-Bench | 0accuracy (%) | unverifiedT1 | 2024-11-20GSO Leaderboard |
| ARC-AGI-2 | 0accuracy (%) | unverifiedT2 | 2024-11-20 |
| HLE | 0accuracy (%) | unverifiedT2 | 2024-11-20 |
Claims drawn from cited facts, not live model generation.
This model was developed by OpenAI and released in 2024.
2 cited facts
This model has scores on 18 tracked benchmarks and currently leads 1 of them. The record’s evidence status is independently reproduced.
3 cited facts
Its mean gap to the best recorded score across its tracked benchmarks is 58.19 points.
1 cited fact
1 facts cross-checked across data sources: 1 single-source.
Source facts, citations, and refresh stamp for this record.
Sources: epoch_benchmarks
GPT-4o (Nov 2024) is an AI model developed by OpenAI, released 2024-11-20. Its benchmark record below tags every score as independently reproduced, self-reported, or unverified.
GPT-4o (Nov 2024) has recorded scores on 18 benchmarks, each shown with its evidence status.
GPT-4o (Nov 2024) has recorded scores on 18 benchmarks — Lech Mazur Writing, GPQA diamond, MATH level 5, OTIS Mock AIME 2024-2025, WeirdML, MMLU, and 12 more. The full table above shows each score with its evidence status.
5 of 18 recorded scores (28%) are independently reproduced rather than self-reported by the lab.
GPT-4o (Nov 2024) has 18 tracked claims: 5 independently reproduced, 1 self-reported, 12 unverified.