The Model Index
Up to four models

Gemini 2.0 Flash (Dec 2024) vs Gemini 1.5 Flash (Sep 2024)

On the index (GPT-4 = 100), Gemini 2.0 Flash (Dec 2024) scores 122 and Gemini 1.5 Flash (Sep 2024) 113. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to Gemini 2.0 Flash (Dec 2024)
Presets
Gemini 2.0 Flash (Dec 2024)
122106–139
WeightsClosed
ReleasedDec 2024
Price in / out–
Context–
Core tests taken0 of 9
Gemini 1.5 Flash (Sep 2024)
11396–129
WeightsClosed
ReleasedSep 2024
Price in / out–
Context–
Core tests taken1 of 9

Gemini 2.0 Flash (Dec 2024) leads Gemini 1.5 Flash (Sep 2024) by 10 points.

Test by testthird-party results

Gemini 2.0 Flash (Dec 2024)Gemini 1.5 Flash (Sep 2024)
0%25%50%75%100%REASONING & KNOWLEDGEMMLU (HELM runs)MMLU (HELM runs)
Every result as a table
TestGemini 2.0 Flash (Dec 2024)Gemini 1.5 Flash (Sep 2024)
Reasoning & knowledge
MMLU (HELM runs)79.7%73.9%

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG