The Model Index
Up to four models

Claude 3.7 Sonnet vs DeepSeek-R1

On the index (GPT-4 = 100), Claude 3.7 Sonnet scores 135 and DeepSeek-R1 130. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to Claude 3.7 Sonnet
Presets
Claude 3.7 Sonnet
135119–151
WeightsClosed
ReleasedFeb 2025
Price in / out–
Context–
Core tests taken4 of 9
DeepSeek-R1
130114–146
WeightsOpen
ReleasedJan 2025
Price in / out–
Context–
Core tests taken2 of 9

Claude 3.7 Sonnet leads DeepSeek-R1 by 5 points, ahead on 2 of 2 shared core tests.

Test by testthird-party results

Claude 3.7 SonnetDeepSeek-R1
0%25%50%75%100%REASONING & KNOWLEDGEGPQA Diamond (Epoch AI)GPQA Diamond (Epoch AI)Fiction.LiveBenchFiction.LiveBenchSimpleBenchSimpleBenchMATHSAIME-style maths (OTIS mock)AIME-style maths (OTIS mock)MATH (level 5)MATH (level 5)CODINGAider PolyglotAider Polyglot
Every result as a table
TestClaude 3.7 SonnetDeepSeek-R1
Reasoning & knowledge
GPQA Diamond (Epoch AI)79.7%71.7%
Fiction.LiveBench83.3%69.4%
SimpleBench46.4%30.9%
Maths
AIME-style maths (OTIS mock)57.8%53.3%
MATH (level 5)91.2%93.0%
Coding
Aider Polyglot64.9%56.9%
Task length · METR36 sec31 sec

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG