Verdict
GPT-5.6 Sol leads 15–2 across 17 shared benchmarks.
GPT-5.6 Sol 15 · Kimi K3 2 · higher isn't always better — check the caveats below.
Reported scores — protocols may differ. How we compare
Reasoning: GPT-5.6 Sol leads 3–0 across 3 shared reasoning benchmarks (largest gap: SimpleQA Verified, 71.6 vs 42.7 — single evaluator).
Unknown: Kimi K3 leads 2–1 across 3 shared unknown benchmarks (largest gap: Mystery Game Puzzles, 53.73 vs 18.48 — single evaluator).
Coding: GPT-5.6 Sol leads 2–0 across 2 shared coding benchmarks (largest gap: DeepSWE, 72.67 vs 68.51 — single evaluator).
Math: GPT-5.6 Sol leads 2–0 across 2 shared math benchmarks (largest gap: FrontierMath-Tier-4-v2-Private, 82.93 vs 39.02 — single evaluator).
GPT-5.6 Sol leads 15–2 across 17 shared benchmarks. GPT-5.6 Sol leads 15 benchmarks and Kimi K3 leads 2. Higher isn't always better — see the integrity caveats on each benchmark.
GPT-5.6 Sol and Kimi K3 have 17 benchmarks in common in our data — those are the only rows where a direct, apples-to-apples comparison is drawn.
GPT-5.6 Sol leads reasoning 3–0. GPT-5.6 Sol leads coding 2–0.