The Model Index
Models/Meta

Llama 3.1

MetaOpen weights

Llama 3.1 is an open-weights AI model from Meta with an index score of 110 (GPT-4 = 100), rank 176 of 217.

11094–127Index score#176 of 217 models
–Price per million tokensno public API price found
–Context windowtokens it reads at once
23 Jul 2024Released2 years 4 months ago

Where it sitson the frontier

801001201401601802002023202420252026GPT-4 at launch = 100Llama 3.1

GPT-4o reached this score 2 months earlier.

Test resultsby area · tick = best by any model

Reasoning & knowledgeevidence
GPQA Diamond (Epoch AI)
51%
Humanity's Last Exam
no result
Mathsevidence
FrontierMath (tiers 1-3)
no result
Codingevidence
SWE-bench Verified
no result
Terminal-Bench 4.0
no result
Agentsevidence
APEX-Agents
no result
Professional workno evidence yet
Finance Agent (v2)
no result
Novel problemsno evidence yet
ARC-AGI-2
no result
Long tasksno evidence yet
METR time horizon
no result

Third-party results only, at the model’s best standard setting. Hover a bar for who ran it.

What others sayrank on 8 leaderboards

Best attop three among current models

Not in the top three among current models on any category we track.

Facts and sources

Released23 Jul 2024
Announcementai.meta.com ↗
Release entryLlama 3.1 (405B)
Scored asLlama 3.1-405B
Output speed–
Hugging Facenot linked

Meta releasesaround this one

This page as a chartDownload PNG