DeepSeek LLM 67B
DeepSeek LLM 67B is an open-weights AI model from DeepSeek with an index score of 87 (GPT-4 = 100), provisional.
8763–112Index scoreProvisional · one third-party tester so far; ranked once a second confirms it
–Price per million tokensno public API price found
–Context windowtokens it reads at once
29 Nov 2023Released3 years ago
Where it sitson the frontier
GPT-4 reached this score 9 months earlier.
Test resultsby area · tick = best by any model
Reasoning & knowledgeevidence
Mathsevidence
Codingno evidence yet
Agentsno evidence yet
Professional workno evidence yet
Novel problemsno evidence yet
Long tasksno evidence yet
Third-party results only, at the model’s best standard setting. Hover a bar for who ran it.
What others sayrank on 6 leaderboards
LMArena · Textoverall chat quality, judged by people#300of 362 · 1185LMArena · Instruction followingfollowing detailed instructions#304of 362 · 1158LMArena · Codingcoding questions in chat#303of 357 · 1218LMArena · Mathsmaths questions in chat#298of 346 · 1156LMArena · Creative writingcreative writing#315of 360 · 1135LMArena · Long promptslong, complex requests#298of 340 · 1186
Best attop three among current models
Not in the top three among current models on any category we track.
Facts and sources
Released29 Nov 2023
Announcementnot linked yet
Release entryDeepSeek LLM 67B
Scored asDeepSeek LLM 67B
Output speed–
Hugging Facenot linked