Verdict
Qwen 3.8 Max leads 5–4 across 9 shared benchmarks.
Kimi K3 4 · Qwen 3.8 Max 5 · higher isn't always better — check the caveats below.
Reported scores — protocols may differ. How we compare
Math: Qwen 3.8 Max leads 2–0 across 2 shared math benchmarks (largest gap: FrontierMath-Tier-4-v2-Private, 46.34 vs 39.02 — single evaluator).
Reasoning: Evenly split 1–1 across 2 shared reasoning benchmarks (largest gap: SimpleQA Verified, 46.29 vs 42.7 — single evaluator).
Unknown: Evenly split 1–1 across 2 shared unknown benchmarks (largest gap: ProofBench, 87 vs 58 — single evaluator).
Qwen 3.8 Max leads 5–4 across 9 shared benchmarks. Kimi K3 leads 4 benchmarks and Qwen 3.8 Max leads 5. Higher isn't always better — see the integrity caveats on each benchmark.
Kimi K3 and Qwen 3.8 Max have 9 benchmarks in common in our data — those are the only rows where a direct, apples-to-apples comparison is drawn.
Qwen 3.8 Max leads math 2–0.