The Model Index
Models/OpenAI

GPT-4o (Nov 2024)

OpenAIReleased 20 Nov 2024Closed
10897–120Index score#167 of 229 models
5/ 8Core tests taken4 of 6 areas · plus 13 anchor tests
−14Versus the frontier at releasebest then: o1-miniReplaced by GPT-4o (Jan 2025)
$2.5/ $10Price per million tokensinput / output, list price
128KContext windowtokens it reads at once

Where it sitson the frontier

GPT-4o reached this score 6 months earlier.

Test resultsby area · tick = best by any model

Reasoning & knowledgeevidence
GPQA Diamond
48%
Humanity's Last Exam
3%
Mathsevidence
FrontierMath T1-3
no result
Codingevidence
SWE-bench Verified
31%
Terminal-Bench
no result
Agentsevidence
APEX-Agents
no result
Novel problemsevidence
ARC-AGI-2
0%
Long tasksevidence
METR time horizon
9.2 min

Independent results from the Epoch AI benchmarking hub, best reasoning setting. The core tests are shown here; anchor tests also inform the score and can be shown above.

What others sayrank on each leaderboard

The Model Indexindependent tests, our method#167of 219 · 108

Further left is better. Leaderboards measure different things: LMArena is people voting blind between two answers, the others are test scores. Click any row for the source.

Best attop three among current models

Replaced by GPT-4o (Jan 2025); it no longer leads any category among current models.

Where this model places in the top three of today's models, on category leaderboards and on our core tests.

Where to use itprices checked 1 Oct 2026

API providers 1 · per million tokens, in / out

OOpenAI$2.5 / $10cheapest

Provider prices come from OpenRouter's live listing; going direct to a provider can differ. Subscriptions are the lab's own apps.

Facts and sources

Released20 Nov 2024
Announcementnot linked yet
Release entry–
Scored asGPT-4o (Nov 2024)
Artificial Analysis index–
Output speed–
Hugging Faceclosed weights

OpenAI releasesaround this one