The Model Index
Up to four models

o3 vs o1

On the index (GPT-4 = 100), o3 scores 147 and o1 136. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

o3o1
Next to o3
Presets
o3
147131–163
WeightsClosed
ReleasedApr 2025
Price in / out$2.0 / $8.0
Context200K
Core tests taken6 of 9
o1
136120–152
WeightsClosed
ReleasedDec 2024
Price in / out–
Context–
Core tests taken4 of 9

o3 leads o1 by 12 points, ahead on 4 of 4 shared core tests.

Test by testthird-party results

o3o1
0%25%50%75%100%REASONING & KNOWLEDGEGPQA Diamond (Epoch AI)GPQA Diamond (Epoch AI)Humanity's Last ExamHumanity's Last ExamFiction.LiveBenchFiction.LiveBenchGeoBenchGeoBenchSimpleBenchSimpleBenchSimpleQA VerifiedSimpleQA VerifiedVPCTVPCTMATHSFrontierMath (tiers 1-3)FrontierMath (tiers 1-3)AIME-style maths (OTIS mock)AIME-style maths (OTIS mock)MATH (level 5)MATH (level 5)Chess puzzlesChess puzzlesFrontierMath (2025 set)FrontierMath (2025 set)CODINGAider PolyglotAider PolyglotCadEvalCadEvalWeirdMLWeirdMLAGENTSDTBenchDTBenchLMCALMCA
Every result as a table
Testo3o1
Reasoning & knowledge
GPQA Diamond (Epoch AI)81.8%76.8%
Humanity's Last Exam20.3%8.0%
Fiction.LiveBench88.9%83.3%
GeoBench74.0%80.0%
SimpleBench53.1%40.1%
SimpleQA Verified49.4%41.1%
VPCT52.0%37.0%
Maths
FrontierMath (tiers 1-3)33.3%14.7%
AIME-style maths (OTIS mock)84.4%73.3%
MATH (level 5)97.8%94.7%
Chess puzzles37.0%11.0%
FrontierMath (2025 set)18.7%9.3%
Coding
Aider Polyglot81.3%61.7%
CadEval74.0%56.0%
WeirdML52.4%46.1%
Agents
DTBench84.8%74.7%
LMCA39.7%22.3%
Task length · METR39 sec31 sec

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG