Verdict
o3 leads 16–1 across 17 shared benchmarks.
o1 1 · o3 16 · higher isn't always better — check the caveats below.
Reported scores — protocols may differ. How we compare
Reasoning: o3 leads 4–0 across 4 shared reasoning benchmarks (largest gap: ARC-AGI, 60.8 vs 30.7 — single evaluator).
Math: o3 leads 3–0 across 3 shared math benchmarks (largest gap: FrontierMath-2025-02-28-Private, 32.78 vs 16.33 — single evaluator).
o3 leads 16–1 across 17 shared benchmarks. o1 leads 1 benchmark and o3 leads 16. Higher isn't always better — see the integrity caveats on each benchmark.
o1 and o3 have 17 benchmarks in common in our data — those are the only rows where a direct, apples-to-apples comparison is drawn.
o3 leads reasoning 4–0. o3 leads math 3–0.