The Model Index
Up to four models

Claude Sonnet 5 vs DeepSeek-V4.1-Flash

On the index (GPT-4 = 100), Claude Sonnet 5 scores 164 and DeepSeek-V4.1-Flash 163. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to Claude Sonnet 5
Presets
Claude Sonnet 5
164148–180
WeightsClosed
ReleasedJun 2026
Price in / out$2.0 / $10
Context1M
Core tests taken5 of 9
DeepSeek-V4.1-Flash
163147–179
WeightsOpen
ReleasedSep 2026
Price in / out$0.051 / $0.57
Context1.05M
Core tests taken6 of 9

Claude Sonnet 5 and DeepSeek-V4.1-Flash are too close to call (1 point apart, within the uncertainty), ahead on 3 of 5 shared core tests, at 22× the price.

Test by testthird-party results

Claude Sonnet 5DeepSeek-V4.1-Flash
0%25%50%75%100%REASONING & KNOWLEDGEGPQA Diamond (Epoch AI)GPQA Diamond (Epoch AI)LiveBench Data AnalysisLiveBench Data AnalysisLiveBench IFLiveBench IFLiveBench LanguageLiveBench LanguageLiveBench ReasoningLiveBench ReasoningSimpleBenchSimpleBenchSimpleQA VerifiedSimpleQA VerifiedMATHSFrontierMath (tiers 1-3)FrontierMath (tiers 1-3)AIME-style maths (OTIS mock)AIME-style maths (OTIS mock)LiveBench MathematicsLiveBench MathematicsProofBench v1.1ProofBench v1.1Chess puzzlesChess puzzlesFrontierMath (tier 4)FrontierMath (tier 4)Surface Evolver BenchSurface Evolver BenchCODINGTerminal-Bench 4.0Terminal-Bench 4.0LiveBench Agentic CodingLiveBench Agentic CodingLiveBench CodingLiveBench CodingCode MigrationCode MigrationCyberBench v1.1CyberBench v1.1IOIIOIProgramBenchProgramBenchVibe Code Bench 1-100Vibe Code Bench 1-100Vibe Code Bench v1.1Vibe Code Bench v1.1MirrorCodeMirrorCodeAGENTSAPEX-AgentsAPEX-AgentsSkillsBenchSkillsBenchSRE BenchSRE BenchTerminal-Bench-ScienceTerminal-Bench-ScienceDTBenchDTBenchLMCALMCAMystery game puzzlesMystery game puzzlesPROFESSIONAL WORKFinance Agent (v2)Finance Agent (v2)EMBEMBLegalBenchLegalBenchLegal Research BenchLegal Research BenchMedCodeMedCodeMedScribeMedScribePublic Benefits Bench v1.1Public Benefits Bench v1.1Tax Agent BenchTax Agent Bench
Every result as a table
TestClaude Sonnet 5DeepSeek-V4.1-Flash
Reasoning & knowledge
GPQA Diamond (Epoch AI)90.5%89.8%
LiveBench Data Analysis71.7%79.3%
LiveBench IF63.9%70.0%
LiveBench Language75.0%81.2%
LiveBench Reasoning88.7%86.7%
SimpleBench60.6%66.7%
SimpleQA Verified33.7%42.9%
Maths
FrontierMath (tiers 1-3)65.6%67.4%
AIME-style maths (OTIS mock)94.7%98.3%
LiveBench Mathematics92.9%93.3%
ProofBench v1.177.0%54.0%
Chess puzzles45.0%48.0%
FrontierMath (tier 4)29.3%26.8%
Surface Evolver Bench60.0%46.3%
Coding
Terminal-Bench 4.010.6%19.7%
LiveBench Agentic Coding59.4%77.3%
LiveBench Coding80.7%80.0%
Code Migration44.4%45.6%
CyberBench v1.170.3%73.7%
IOI45.0%40.3%
ProgramBench0.0%0.5%
Vibe Code Bench 1-10013.8%16.4%
Vibe Code Bench v1.181.3%84.7%
MirrorCode63.3%64.4%
Agents
APEX-Agents54.5%39.5%
SkillsBench46.5%69.8%
SRE Bench0.4%0.8%
Terminal-Bench-Science5.7%0.0%
DTBench92.5%89.9%
LMCA50.0%47.0%
Mystery game puzzles35.0%43.0%
Professional work
Finance Agent (v2)53.9%53.5%
EMB66.3%57.2%
LegalBench83.9%83.3%
Legal Research Bench41.8%41.3%
MedCode47.5%41.2%
MedScribe76.0%85.5%
Public Benefits Bench v1.166.0%64.3%
Tax Agent Bench29.4%26.6%

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG