The Model Index
Up to four models

Gemini 2.0 Flash Thinking (Jan 2025) vs Claude 3.5 Sonnet

On the index (GPT-4 = 100), Gemini 2.0 Flash Thinking (Jan 2025) scores 123 and Claude 3.5 Sonnet 122. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to Gemini 2.0 Flash Thinking (Jan 2025)
Presets
Gemini 2.0 Flash Thinking (Jan 2025)
123107–139
WeightsClosed
ReleasedJan 2025
Price in / out–
Context–
Core tests taken2 of 9
Claude 3.5 Sonnet
122107–138
WeightsClosed
ReleasedOct 2024
Price in / out–
Context–
Core tests taken3 of 9

Gemini 2.0 Flash Thinking (Jan 2025) and Claude 3.5 Sonnet are too close to call (1 point apart, within the uncertainty), ahead on 2 of 2 shared core tests.

Test by testthird-party results

Gemini 2.0 Flash Thinking (Jan 2025)Claude 3.5 Sonnet
0%25%50%75%100%REASONING & KNOWLEDGEGPQA Diamond (Epoch AI)GPQA Diamond (Epoch AI)Humanity's Last ExamHumanity's Last ExamGeoBenchGeoBenchSimpleBenchSimpleBenchMATHSAIME-style maths (OTIS mock)AIME-style maths (OTIS mock)CODINGAider PolyglotAider Polyglot
Every result as a table
TestGemini 2.0 Flash Thinking (Jan 2025)Claude 3.5 Sonnet
Reasoning & knowledge
GPQA Diamond (Epoch AI)57.1%55.3%
Humanity's Last Exam6.6%4.1%
GeoBench70.0%62.0%
SimpleBench30.7%41.4%
Maths
AIME-style maths (OTIS mock)57.8%8.5%
Coding
Aider Polyglot18.2%51.6%
Task length · METR27 sec

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG