Verdict
phi-3-medium 14B leads 5–2 across 8 shared benchmarks.
phi-3-medium 14B 5 · phi-3-small 7.4B 2 · 1 tied · higher isn't always better — check the caveats below.
Reported scores — protocols may differ. How we compare
Reasoning: phi-3-medium 14B leads 2–1 across 3 shared reasoning benchmarks (largest gap: BBH, 75.2 vs 72.13 — single evaluator).
Commonsense Reasoning: phi-3-medium 14B leads 1–0 across 2 shared commonsense reasoning benchmarks (largest gap: HellaSwag, 76.53 vs 69.33 — single evaluator).
Vendor claims — compare against the measured scores above. A claim is what a developer says about its own model, not an independent measurement.
No vendor claims on file for phi-3-medium 14B.
General
“Phi-3-Small-8K-Instruct is a 7B parameters, lightweight, state-of-the-art open model”
Reasoning
“Phi-3-Small-8K-Instruct showcased a robust and state-of-the-art performance among models of the same-size and next-size-up”
phi-3-medium 14B leads 5–2 across 8 shared benchmarks. phi-3-medium 14B leads 5 benchmarks and phi-3-small 7.4B leads 2, with 1 tied. Higher isn't always better — see the integrity caveats on each benchmark.
phi-3-medium 14B and phi-3-small 7.4B have 8 benchmarks in common in our data — those are the only rows where a direct, apples-to-apples comparison is drawn.
phi-3-medium 14B leads knowledge 2–0. phi-3-medium 14B leads reasoning 2–1.