Verdict
GPT-6 Astra leads 15–0 across 17 shared benchmarks.
GPT-6 Astra 15 · GPT-6 Sol 0 · 2 tied · higher isn't always better — check the caveats below.
Reported scores — protocols may differ. How we compare
Unknown: GPT-6 Astra leads 6–0 across 7 shared unknown benchmarks (largest gap: Furniture Assembly, 71.43 vs 40.48 — protocols undisclosed).
Reasoning: GPT-6 Astra leads 3–0 across 3 shared reasoning benchmarks (largest gap: SimpleQA Verified, 75.6 vs 60.7 — protocols undisclosed).
Math: GPT-6 Astra leads 1–0 across 2 shared math benchmarks (largest gap: FrontierMath-Tier-4-v2-Private, 97.6 vs 90 — protocols undisclosed).
GPT-6 Astra leads 15–0 across 17 shared benchmarks. GPT-6 Astra leads 15 benchmarks and GPT-6 Sol leads 0, with 2 tied. Higher isn't always better — see the integrity caveats on each benchmark.
GPT-6 Astra and GPT-6 Sol have 17 benchmarks in common in our data — those are the only rows where a direct, apples-to-apples comparison is drawn.
GPT-6 Astra leads unknown 6–0. GPT-6 Astra leads reasoning 3–0.