The Model Index
Models/Meta

Llama 3

MetaOpen weights

Llama 3 is an open-weights AI model from Meta with an index score of 101 (GPT-4 = 100), rank 194 of 217.

10184–118Index score#194 of 217 models
–Price per million tokensno public API price found
–Context windowtokens it reads at once
18 Apr 2024ReleasedReplaced by Llama 3.1-70B

Where it sitson the frontier

801001201401601802002023202420252026GPT-4 at launch = 100Llama 3

GPT-4 (Jun 2023) reached this score 10 months earlier.

Test resultsby area · tick = best by any model

Reasoning & knowledgeevidence
GPQA Diamond (Epoch AI)
41%
Humanity's Last Exam
no result
Mathsevidence
FrontierMath (tiers 1-3)
no result
Codingno evidence yet
SWE-bench Verified
no result
Terminal-Bench 4.0
no result
Agentsevidence
APEX-Agents
no result
Professional workno evidence yet
Finance Agent (v2)
no result
Novel problemsno evidence yet
ARC-AGI-2
no result
Long tasksno evidence yet
METR time horizon
no result

Third-party results only, at the model’s best standard setting. Hover a bar for who ran it.

What others sayrank on 8 leaderboards

Best attop three among current models

Replaced by Llama 3.1-70B; it no longer leads any category among current models.

Facts and sources

Released18 Apr 2024
Announcementai.meta.com ↗
Release entryLlama 3
Scored asLlama 3-70B
Output speed–
Hugging Facenot linked

Meta releasesaround this one

This page as a chartDownload PNG