113101–125Index score#151 · provisional, limited data
1/ 8Core tests taken1 of 6 areas · plus 2 anchor tests
−23Versus the frontier at releasebest then: o1
$0.26/ $0.78Price per million tokensinput / output, list price
1MContext windowtokens it reads at once
Where it sitson the frontier
o1-mini reached this score 4 months earlier.
Test resultsby area · tick = best by any model
Reasoning & knowledgeevidence
Humanity's Last Examno result Mathsevidence
FrontierMath T1-3no result Codingno evidence yet
SWE-bench Verifiedno result Novel problemsno evidence yet
Long tasksno evidence yet
METR time horizonno result Independent results from the Epoch AI benchmarking hub, best reasoning setting. The core tests are shown here; anchor tests also inform the score and can be shown above.
What others sayrank on each leaderboard
The Model Indexindependent tests, our method#151of 219 · 113
Further left is better. Leaderboards measure different things: LMArena is people voting blind between two answers, the others are test scores. Click any row for the source.
Best attop three among current models
Not in the top three among current models on any category we track.
Where this model places in the top three of today's models, on category leaderboards and on our core tests.