Verdict
GPT-5.4 Pro leads 6–5 across 11 shared benchmarks.
Gemini 3.1 Pro 5 · GPT-5.4 Pro 6 · higher isn't always better — check the caveats below.
Reported scores — protocols may differ. How we compare
Reasoning: Gemini 3.1 Pro leads 4–1 across 5 shared reasoning benchmarks (largest gap: SimpleQA Verified, 77.3 vs 47.8 — single evaluator).
Vendor claims — compare against the measured scores above. A claim is what a developer says about its own model, not an independent measurement.
Agentic / Tool Use
“Gemini 3.1 Pro was evaluated across a range of benchmarks, including reasoning, multimodal capabilities, agentic tool use, multi-lingual performance, and long-context.”
Multimodal
“a suite of highly capable, natively multimodal reasoning models”
Reasoning
“Gemini 3.1 Pro is Google's most advanced model for complex tasks.”
No vendor claims on file for GPT-5.4 Pro.
GPT-5.4 Pro leads 6–5 across 11 shared benchmarks. Gemini 3.1 Pro leads 5 benchmarks and GPT-5.4 Pro leads 6. Higher isn't always better — see the integrity caveats on each benchmark.
Gemini 3.1 Pro and GPT-5.4 Pro have 11 benchmarks in common in our data — those are the only rows where a direct, apples-to-apples comparison is drawn.
Gemini 3.1 Pro leads reasoning 4–1.