> Llama 3.1 is an open-weights AI model from Meta, released 23 Jul 2024. Index score 108 (GPT-4 = 100), rank 164 of 229 ranked models.

[Models](https://themodelindex.org/models/) /[Meta](https://themodelindex.org/labs/meta/)

# Llama 3.1

Meta

Released 23 Jul 2024

Open

Date verified

[Compare](https://themodelindex.org/compare/llama-3-1-vs-claude-3-5-sonnet/) [Announcement](https://ai.meta.com/blog/meta-llama-3-1/)

10897–120

Index score

#164 of 229 models

1/ 8

Core tests taken

1 of 6 areas · plus 8 anchor tests

−3

Versus the frontier at release

best then: Claude 3.5 Sonnet (Jun 2024)

–

Price per million tokens

no public API price found

–

Context window

tokens it reads at once

## Where it sits · on the frontier

_Chart: Model Index score of every scored model since late 2022, with the best closed and best open model over time_

GPT-4o reached this score 2 months earlier.

## Test results · by area · tick = best by any model

Show 7 anchor tests

Reasoning & knowledge

evidence

GPQA Diamond

51%

Humanity's Last Exam

no result

Maths

evidence

FrontierMath T1-3

no result

Coding

evidence

SWE-bench Verified

no result

Terminal-Bench

no result

Agents

evidence

APEX-Agents

no result

Novel problems

no evidence yet

ARC-AGI-2

no result

Long tasks

no evidence yet

METR time horizon

no result

Independent results from the Epoch AI benchmarking hub, best reasoning setting. The core tests are shown here; anchor tests also inform the score and can be shown above.

## What others say · rank on each leaderboard

The Model Index

independent tests, our method

#164

of 219 · 108

Epoch Capabilities Index

overall capability from many benchmarks

#140

of 239 · 128.8

Artificial Analysis Intelligence Index

overall capability across ten evaluations

#153

of 207 · 7

Further left is better. Leaderboards measure different things: LMArena is people voting blind between two answers, the others are test scores. Click any row for the source.

## Best at · top three among current models

Not in the top three among current models on any category we track.

Where this model places in the top three of today's models, on category leaderboards and on our core tests.

## Where to use it · prices checked 1 Oct 2026

#### API providers · 2 · per million tokens, in / out

D

DeepInfra

$0.40 / $0.40 · fp8

cheapest

A

Amazon Bedrock

$0.72 / $0.72

↗

#### Run it yourself

🤗

Official weights

meta-llama/Meta-Llama-3.1-70B-Instruct

↗

Provider prices come from OpenRouter's live listing; going direct to a provider can differ. Subscriptions are the lab's own apps.

## Facts and sources

Released

23 Jul 2024

Announcement

[ai.meta.com ↗](https://ai.meta.com/blog/meta-llama-3-1/)

Release entry

Llama 3.1 (405B)

Scored as

Llama 3.1-405B

Artificial Analysis index

–

Output speed

–

Hugging Face

not linked

## Meta releases · around this one

Code Llama

Open

24 AUG 2023

Llama 3

Open

18 APR 2024

index 98

Llama 3.1

Open

23 JUL 2024

index 108

Llama 3.2

Open

25 SEP 2024

index 103

Llama 3.3 70B

Open

6 DEC 2024

index 106

---
Source: https://themodelindex.org/models/llama-3-1/ · The Model Index · data as of 2026-10-01
