Verdict
o3 leads 13–7 across 20 shared benchmarks.
Gemini 2.5 Pro (Jun 2025) 7 · o3 13 · higher isn't always better — check the caveats below.
Reported scores — protocols may differ. How we compare
Reasoning: Gemini 2.5 Pro (Jun 2025) leads 3–2 across 5 shared reasoning benchmarks (largest gap: ARC-AGI, 60.83 vs 41 — single evaluator).
Unknown: o3 leads 3–0 across 3 shared unknown benchmarks (largest gap: METR Time Horizons, 65.44 vs 55.44 — single evaluator).
o3 leads 13–7 across 20 shared benchmarks. Gemini 2.5 Pro (Jun 2025) leads 7 benchmarks and o3 leads 13. Higher isn't always better — see the integrity caveats on each benchmark.
Gemini 2.5 Pro (Jun 2025) and o3 have 20 benchmarks in common in our data — those are the only rows where a direct, apples-to-apples comparison is drawn.
o3 leads unknown 3–0. Gemini 2.5 Pro (Jun 2025) leads reasoning 3–2.