Where it sitson the frontier
Among the first models to reach this score.
Test resultsby area · tick = best by any model
Reasoning & knowledgeevidence
Humanity's Last Examno result Mathsevidence
FrontierMath T1-3no result Codingno evidence yet
SWE-bench Verifiedno result Novel problemsno evidence yet
Independent results from the Epoch AI benchmarking hub, best reasoning setting. The core tests are shown here; anchor tests also inform the score and can be shown above.
What others sayrank on each leaderboard
Further left is better. Leaderboards measure different things: LMArena is people voting blind between two answers, the others are test scores. Click any row for the source.
Best attop three among current models
Replaced by GPT-4 (Jun 2023); it no longer leads any category among current models.
Where this model places in the top three of today's models, on category leaderboards and on our core tests.