The Model Index
Up to four models

Gemini 1.5 Flash (Sep 2024) vs Llama 4 Scout

On the index (GPT-4 = 100), Gemini 1.5 Flash (Sep 2024) scores 113 and Llama 4 Scout 112. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to Gemini 1.5 Flash (Sep 2024)
Presets
Gemini 1.5 Flash (Sep 2024)
11396–129
WeightsClosed
ReleasedSep 2024
Price in / out–
Context–
Core tests taken1 of 9
Llama 4 Scout
11296–128
WeightsOpen
ReleasedApr 2025
Price in / out$0.10 / $0.30
Context1.31M
Core tests taken2 of 9

Gemini 1.5 Flash (Sep 2024) and Llama 4 Scout are too close to call (1 point apart, within the uncertainty), ahead on 0 of 1 shared core tests.

Test by testthird-party results

Gemini 1.5 Flash (Sep 2024)Llama 4 Scout
0%25%50%75%100%REASONING & KNOWLEDGEGPQA Diamond (Epoch AI)GPQA Diamond (Epoch AI)MATHSAIME-style maths (OTIS mock)AIME-style maths (OTIS mock)MATH (level 5)MATH (level 5)FrontierMath (2025 set)FrontierMath (2025 set)AGENTSDTBenchDTBench
Every result as a table
TestGemini 1.5 Flash (Sep 2024)Llama 4 Scout
Reasoning & knowledge
GPQA Diamond (Epoch AI)47.3%51.8%
Maths
AIME-style maths (OTIS mock)16.3%7.8%
MATH (level 5)61.9%62.3%
FrontierMath (2025 set)0.0%0.0%
Agents
DTBench53.8%57.9%

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG