Verdict
o3 leads 18–1 across 19 shared benchmarks.
o1 1 · o3 18 · higher isn't always better — check the caveats below.
Reported scores — protocols may differ. How we compare
Reasoning: o3 leads 5–0 across 5 shared reasoning benchmarks (largest gap: ARC-AGI, 60.83 vs 30.7 — single evaluator).
Unknown: o3 leads 3–0 across 3 shared unknown benchmarks (largest gap: LMCA, 46.71 vs 26.2 — single evaluator).
Math: o3 leads 2–0 across 2 shared math benchmarks (largest gap: OTIS Mock AIME 2024-2025, 84.43 vs 73.31 — single evaluator).
o3 leads 18–1 across 19 shared benchmarks. o1 leads 1 benchmark and o3 leads 18. Higher isn't always better — see the integrity caveats on each benchmark.
o1 and o3 have 19 benchmarks in common in our data — those are the only rows where a direct, apples-to-apples comparison is drawn.
o3 leads reasoning 5–0. o3 leads unknown 3–0.