The Model Index
Models/Anthropic

Claude 3.5 Sonnet

AnthropicReleased 22 Oct 2024ClosedFlagshipDate verified
118107–130Index score#143 of 229 models
3/ 8Core tests taken2 of 6 areas · plus 16 anchor tests
−5Versus the frontier at releasebest then: o1-miniReplaced by Claude 3.7 Sonnet
–Price per million tokensno public API price found
–Context windowtokens it reads at once

Where it sitson the frontier

o1-mini reached this score 1 month earlier.

Test resultsby area · tick = best by any model

Reasoning & knowledgeevidence
GPQA Diamond
55%
Humanity's Last Exam
4%
Mathsevidence
FrontierMath T1-3
no result
Codingevidence
SWE-bench Verified
no result
Terminal-Bench
no result
Agentsevidence
APEX-Agents
no result
Novel problemsno evidence yet
ARC-AGI-2
no result
Long tasksevidence
METR time horizon
21 min

Independent results from the Epoch AI benchmarking hub, best reasoning setting. The core tests are shown here; anchor tests also inform the score and can be shown above.

What others sayrank on each leaderboard

The Model Indexindependent tests, our method#143of 219 · 118

Further left is better. Leaderboards measure different things: LMArena is people voting blind between two answers, the others are test scores. Click any row for the source.

Best attop three among current models

Replaced by Claude 3.7 Sonnet; it no longer leads any category among current models.

Where this model places in the top three of today's models, on category leaderboards and on our core tests.

Where to use itprices checked 1 Oct 2026

Provider prices come from OpenRouter's live listing; going direct to a provider can differ. Subscriptions are the lab's own apps.

Facts and sources

Released22 Oct 2024
Announcementanthropic.com ↗
Release entryClaude 3.5 Sonnet (new) + 3.5 Haiku (avail. 11-04)
Scored asClaude 3.5 Sonnet (October 2024)
Artificial Analysis index–
Output speed–
Hugging Faceclosed weights

Anthropic releasesaround this one