Google DeepMind·released 2024-12-111 source
Gemini 2.0 Flash (Dec 2024) benchmark scores: 4 benchmarks tracked. 0% of its scores are independently reproduced — the rest are self-reported or unverified.
Leads on 0 of 4 benchmarks·best result 72.93 on MMLU (unverified)·0 of 4 independently reproduced
| Benchmark | Score | Evidence status | Measured |
|---|---|---|---|
| MMLU | 72.93accuracy (%) | unverified· optimizedT1 | 2024-12-11Stanford CRFM Leaderboard |
| Lech Mazur Writing | 71.5accuracy (%) | unverifiedT1 | 2024-12-11lechmazur/writing Github repository |
| Aider polyglot | 38.2accuracy (%) | unverified· optimizedT1 | 2024-12-11Aider LLM Leaderboards |
| SimpleBench | 17.32accuracy (%) | unverifiedT1 | 2024-12-11SimpleBench Leaderboard |
Claims drawn from cited facts, not live model generation.
This model was developed by Google DeepMind and released in 2024.
2 cited facts
Sampled on just 4 benchmarks, this record is a sketch; a single new score could redraw it. It currently holds no top score in any of them. The record is unverified: these scores have neither been independently confirmed nor disputed, so they should be treated as unverified claims.
3 cited facts
With an average gap of 34.44 points behind the state-of-the-art on its benchmarks, this model trails the leaders by a wide margin and holds no top scores. That places it well behind the front of the pack.
2 cited facts
1 facts cross-checked across data sources: 1 single-source.
Source facts, citations, and refresh stamp for this record.
Sources: epoch_benchmarks
Gemini 2.0 Flash (Dec 2024) is an AI model developed by Google DeepMind, released 2024-12-11. Its benchmark record below tags every score as independently reproduced, self-reported, or unverified.
Gemini 2.0 Flash (Dec 2024) has recorded scores on 4 benchmarks, each shown with its evidence status.
Gemini 2.0 Flash (Dec 2024) has recorded scores on 4 benchmarks — Lech Mazur Writing, MMLU, SimpleBench, Aider polyglot. The full table above shows each score with its evidence status.
0 of 4 recorded scores (0%) are independently reproduced rather than self-reported by the lab.
Gemini 2.0 Flash (Dec 2024) has 4 tracked claims: 4 unverified.