The Model Index
Up to four models

o4-mini vs Gemini 2.5 Pro

On the index (GPT-4 = 100), o4-mini scores 141 and Gemini 2.5 Pro 141. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to o4-mini
Presets
o4-mini
141126–157
WeightsClosed
ReleasedApr 2025
Price in / out–
Context–
Core tests taken5 of 9
Gemini 2.5 Pro
141125–157
WeightsClosed
ReleasedMar 2025
Price in / out–
Context–
Core tests taken2 of 9

o4-mini and Gemini 2.5 Pro are too close to call (0 points apart, within the uncertainty), ahead on 0 of 2 shared core tests.

Test by testthird-party results

o4-miniGemini 2.5 Pro
0%25%50%75%100%REASONING & KNOWLEDGEGPQA Diamond (Epoch AI)GPQA Diamond (Epoch AI)Humanity's Last ExamHumanity's Last ExamFiction.LiveBenchFiction.LiveBenchGeoBenchGeoBenchSimpleBenchSimpleBenchVPCTVPCTMATHSMATH (level 5)MATH (level 5)CODINGAider PolyglotAider PolyglotCadEvalCadEval
Every result as a table
Testo4-miniGemini 2.5 Pro
Reasoning & knowledge
GPQA Diamond (Epoch AI)79.6%83.8%
Humanity's Last Exam18.1%18.2%
Fiction.LiveBench77.8%66.7%
GeoBench64.0%78.0%
SimpleBench38.7%51.6%
VPCT57.5%48.0%
Maths
MATH (level 5)97.8%95.6%
Coding
Aider Polyglot72.0%72.9%
CadEval62.0%64.0%
Task length · METR38 sec

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG