The Model Index
Models/Meta

Llama 3.1-8B

MetaReleased 23 Jul 2024Open
Compare
8975–102Index score#203 of 229 models
1/ 8Core tests taken1 of 6 areas · plus 8 anchor tests
−22Versus the frontier at releasebest then: Claude 3.5 Sonnet (Jun 2024)
$0.050/ $0.080Price per million tokensinput / output, list price
131KContext windowtokens it reads at once

Where it sitson the frontier

GPT-4 reached this score 16 months earlier.

Test resultsby area · tick = best by any model

Reasoning & knowledgeevidence
GPQA Diamond
27%
Humanity's Last Exam
no result
Mathsevidence
FrontierMath T1-3
no result
Codingevidence
SWE-bench Verified
no result
Terminal-Bench
no result
Agentsevidence
APEX-Agents
no result
Novel problemsno evidence yet
ARC-AGI-2
no result
Long tasksno evidence yet
METR time horizon
no result

Independent results from the Epoch AI benchmarking hub, best reasoning setting. The core tests are shown here; anchor tests also inform the score and can be shown above.

What others sayrank on each leaderboard

The Model Indexindependent tests, our method#203of 219 · 89
Epoch Capabilities Indexoverall capability from many benchmarks#180of 239 · 116.6LMArena · Codingcoding questions in chat#310of 383 · 1260LMArena · Textoverall chat quality, judged by people#316of 388 · 1211LMArena · Creative writingcreative writing#315of 386 · 1177LMArena · Mathsmaths questions in chat#313of 373 · 1189

Further left is better. Leaderboards measure different things: LMArena is people voting blind between two answers, the others are test scores. Click any row for the source.

Best attop three among current models

Not in the top three among current models on any category we track.

Where this model places in the top three of today's models, on category leaderboards and on our core tests.

Where to use itprices checked 1 Oct 2026

API providers 5 · per million tokens, in / out

DDeepInfra$0.020 / $0.040 · fp8cheapestNNovita$0.020 / $0.050 · fp8↗GGroq$0.050 / $0.080↗CCloudflare$0.15 / $0.29 · fp8↗CCoreWeave$0.22 / $0.22 · bf16↗

Run it yourself

🤗Official weightsmeta-llama/Meta-Llama-3.1-8B-Instruct↗

Provider prices come from OpenRouter's live listing; going direct to a provider can differ. Subscriptions are the lab's own apps.

Facts and sources

Released23 Jul 2024
Announcementnot linked yet
Release entry–
Scored asLlama 3.1-8B
Artificial Analysis index–
Output speed–

Meta releasesaround this one

LLaMAOpen
Llama 2Open
index 88