Verdict
Evenly split 7–7 across 15 shared benchmarks.
Grok 4 7 · o3 7 · 1 tied · higher isn't always better — check the caveats below.
Reported scores — protocols may differ. How we compare
Reasoning: Grok 4 leads 4–0 across 4 shared reasoning benchmarks (largest gap: SimpleBench, 52.6 vs 43.72 — single evaluator).
Math: o3 leads 1–0 across 2 shared math benchmarks (largest gap: OTIS Mock AIME 2024-2025, 84.43 vs 83.98 — single evaluator).
Evenly split 7–7 across 15 shared benchmarks. Grok 4 leads 7 benchmarks and o3 leads 7, with 1 tied. Higher isn't always better — see the integrity caveats on each benchmark.
Grok 4 and o3 have 15 benchmarks in common in our data — those are the only rows where a direct, apples-to-apples comparison is drawn.
Grok 4 leads reasoning 4–0. o3 leads math 1–0.