Falcon-180B vs phi-3-small 7.4B
- Score
- Falcon-180B 2 · phi-3-small 7.4B 3 — higher isn't always better; check the caveats.
- Shared
- 5 benchmarks measured for both models
- Integrity
- 0 of 5 graded A or B
Reported scores — protocols may differ. How we compare
Each bar is drawn on its benchmark's own scale — the ceiling the record states where it has one (of 100), otherwise the best score recorded on that benchmark (rel. 2103). The margin is in points: + is Falcon-180B, - is phi-3-small 7.4B.
Commonsense Reasoning: Falcon-180B leads 2–0 across 2 shared commonsense reasoning benchmarks (largest gap: HellaSwag, 85.33 vs 69.33 — single evaluator).
Vendor claims — compare against the measured scores above. A claim is what a developer says about its own model, not an independent measurement.
No vendor claims on file for Falcon-180B.
General
“Phi-3-Small-8K-Instruct is a 7B parameters, lightweight, state-of-the-art open model”
Reasoning
“Phi-3-Small-8K-Instruct showcased a robust and state-of-the-art performance among models of the same-size and next-size-up”
phi-3-small 7.4B leads 3–2 across 5 shared benchmarks. Falcon-180B leads 2 benchmarks and phi-3-small 7.4B leads 3. Higher isn't always better — see the integrity caveats on each benchmark.
Falcon-180B and phi-3-small 7.4B have 5 benchmarks in common in our data — those are the only rows where a direct, apples-to-apples comparison is drawn.
Falcon-180B leads commonsense reasoning 2–0. phi-3-small 7.4B leads knowledge 2–0.