The Model Index
Models/DeepSeek

DeepSeek-V2.5 (Sep 2024)

DeepSeekReleased 6 Sep 2024Open
Compare
–Index scoreNot yet evaluated independently
0/ 8Core tests taken0 of 6 areas · plus 1 anchor tests
–Versus the frontier at releaseReplaced by DeepSeek-V3
–Price per million tokensno public API price found
–Context windowtokens it reads at once

Where it sitson the frontier

Claude 3.5 Sonnet (Jun 2024) reached this score 3 months earlier.

Test resultsby area · tick = best by any model

Reasoning & knowledgeno evidence yet
GPQA Diamond
no result
Humanity's Last Exam
no result
Mathsno evidence yet
FrontierMath T1-3
no result
Codingevidence
SWE-bench Verified
no result
Terminal-Bench
no result
Agentsno evidence yet
APEX-Agents
no result
Novel problemsno evidence yet
ARC-AGI-2
no result
Long tasksno evidence yet
METR time horizon
no result

Independent results from the Epoch AI benchmarking hub, best reasoning setting. The core tests are shown here; anchor tests also inform the score and can be shown above.

What others sayrank on each leaderboard

LMArena · Codingcoding questions in chat#224of 383 · 1368LMArena · Mathsmaths questions in chat#238of 373 · 1287LMArena · Textoverall chat quality, judged by people#251of 388 · 1307LMArena · Creative writingcreative writing#257of 386 · 1265

Further left is better. Leaderboards measure different things: LMArena is people voting blind between two answers, the others are test scores. Click any row for the source.

Best attop three among current models

Replaced by DeepSeek-V3; it no longer leads any category among current models.

Where this model places in the top three of today's models, on category leaderboards and on our core tests.

Facts and sources

Released6 Sep 2024
Announcementnot linked yet
Release entry–
Scored asDeepSeek-V2.5 (Sep 2024)
Artificial Analysis index–
Output speed–
Hugging Facenot linked

DeepSeek releasesaround this one

DeepSeek CoderOpen
DeepSeek LLM 67BOpen
index 82