The Model Index
Up to four models

DeepSeek-V4.1-Flash vs DeepSeek-V4-Pro

On the index (GPT-4 = 100), DeepSeek-V4.1-Flash scores 170 and DeepSeek-V4-Pro 169. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to DeepSeek-V4.1-Flash
Presets
DeepSeek-V4.1-Flash
170153–186
WeightsOpen
ReleasedSep 2026
Price in / out$0.14 / $0.42
Context1.05M
Core tests taken6 of 9
DeepSeek-V4-Pro
169152–185
WeightsOpen
ReleasedAug 2026
Price in / out$1.32 / $3.96
Context1.05M
Core tests taken6 of 9

DeepSeek-V4.1-Flash and DeepSeek-V4-Pro are too close to call (1 point apart, within the uncertainty), ahead on 4 of 6 shared core tests, and costs 9.4× less.

Test by testthird-party results

DeepSeek-V4.1-FlashDeepSeek-V4-Pro
0%25%50%75%100%REASONING & KNOWLEDGEGPQA Diamond (Epoch AI)GPQA Diamond (Epoch AI)LiveBench Data AnalysisLiveBench Data AnalysisLiveBench IFLiveBench IFLiveBench LanguageLiveBench LanguageLiveBench ReasoningLiveBench ReasoningSimpleQA VerifiedSimpleQA VerifiedMATHSFrontierMath (tiers 1-3)FrontierMath (tiers 1-3)AIME-style maths (OTIS mock)AIME-style maths (OTIS mock)LiveBench MathematicsLiveBench MathematicsProofBench v1.1ProofBench v1.1Chess puzzlesChess puzzlesFrontierMath (tier 4)FrontierMath (tier 4)CODINGTerminal-Bench 4.0Terminal-Bench 4.0LiveBench Agentic CodingLiveBench Agentic CodingLiveBench CodingLiveBench CodingCode MigrationCode MigrationCyberBench v1.1CyberBench v1.1IOIIOIProgramBenchProgramBenchVibe Code Bench 1-100Vibe Code Bench 1-100Vibe Code Bench v1.1Vibe Code Bench v1.1AGENTSAPEX-AgentsAPEX-AgentsSkillsBenchSkillsBenchSRE BenchSRE BenchTerminal-Bench-ScienceTerminal-Bench-ScienceDTBenchDTBenchLMCALMCAMystery game puzzlesMystery game puzzlesPROFESSIONAL WORKFinance Agent (v2)Finance Agent (v2)EMBEMBLegalBenchLegalBenchLegal Research BenchLegal Research BenchMedCodeMedCodeMedScribeMedScribeTax Agent BenchTax Agent BenchNOVEL PROBLEMSARC-AGI-2ARC-AGI-2ARC-AGI-1ARC-AGI-1
Every result as a table
TestDeepSeek-V4.1-FlashDeepSeek-V4-Pro
Reasoning & knowledge
GPQA Diamond (Epoch AI)89.8%91.7%
LiveBench Data Analysis79.3%79.2%
LiveBench IF70.0%67.7%
LiveBench Language81.2%82.1%
LiveBench Reasoning86.7%85.8%
SimpleQA Verified42.9%52.9%
Maths
FrontierMath (tiers 1-3)67.4%64.6%
AIME-style maths (OTIS mock)98.3%98.6%
LiveBench Mathematics93.3%95.1%
ProofBench v1.154.0%50.0%
Chess puzzles48.0%46.0%
FrontierMath (tier 4)26.8%26.8%
Coding
Terminal-Bench 4.019.7%14.1%
LiveBench Agentic Coding77.3%54.9%
LiveBench Coding80.0%77.2%
Code Migration45.6%41.5%
CyberBench v1.173.7%72.9%
IOI40.3%51.6%
ProgramBench0.5%0.0%
Vibe Code Bench 1-10016.4%17.5%
Vibe Code Bench v1.184.7%82.3%
Agents
APEX-Agents39.5%47.3%
SkillsBench69.8%53.8%
SRE Bench0.8%1.9%
Terminal-Bench-Science0.0%4.3%
DTBench89.9%93.9%
LMCA47.0%45.5%
Mystery game puzzles43.0%43.0%
Professional work
Finance Agent (v2)53.5%50.4%
EMB57.2%52.8%
LegalBench83.3%82.4%
Legal Research Bench41.3%40.9%
MedCode41.2%42.5%
MedScribe85.5%80.2%
Tax Agent Bench26.6%26.8%
Novel problems
ARC-AGI-272.9%61.3%
ARC-AGI-194.5%90.5%

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG