The Model Index
Up to four models

Gemini 1.5 Pro (Sept 2024) vs Llama 4 Maverick

On the index (GPT-4 = 100), Gemini 1.5 Pro (Sept 2024) scores 117 and Llama 4 Maverick 116. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to Gemini 1.5 Pro (Sept 2024)
Presets
Gemini 1.5 Pro (Sept 2024)
117101–133
WeightsClosed
ReleasedSep 2024
Price in / out–
Context–
Core tests taken2 of 9
Llama 4 Maverick
116100–132
WeightsOpen
ReleasedApr 2025
Price in / out$0.35 / $1.0
Context524K
Core tests taken3 of 9

Gemini 1.5 Pro (Sept 2024) and Llama 4 Maverick are too close to call (1 point apart, within the uncertainty), ahead on 0 of 2 shared core tests.

Test by testthird-party results

Gemini 1.5 Pro (Sept 2024)Llama 4 Maverick
0%25%50%75%100%REASONING & KNOWLEDGEGPQA Diamond (Epoch AI)GPQA Diamond (Epoch AI)Humanity's Last ExamHumanity's Last ExamSimpleBenchSimpleBenchMATHSAIME-style maths (OTIS mock)AIME-style maths (OTIS mock)MATH (level 5)MATH (level 5)CODINGWeirdMLWeirdMLAGENTSDTBenchDTBench
Every result as a table
TestGemini 1.5 Pro (Sept 2024)Llama 4 Maverick
Reasoning & knowledge
GPQA Diamond (Epoch AI)57.2%67.0%
Humanity's Last Exam4.6%5.7%
SimpleBench27.1%27.7%
Maths
AIME-style maths (OTIS mock)23.1%20.6%
MATH (level 5)70.4%73.0%
Coding
WeirdML22.2%24.5%
Agents
DTBench59.0%61.9%

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG