The Model Index
Up to four models

Claude Opus 4.8 vs Claude Opus 4.7

On the index (GPT-4 = 100), Claude Opus 4.8 scores 170 and Claude Opus 4.7 167. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to Claude Opus 4.8
Presets
Claude Opus 4.8
170154–186
WeightsClosed
ReleasedMay 2026
Price in / out$5.0 / $25
Context1M
Core tests taken6 of 9
Claude Opus 4.7
167151–183
WeightsClosed
ReleasedApr 2026
Price in / out$5.0 / $25
Context1M
Core tests taken6 of 9

Claude Opus 4.8 and Claude Opus 4.7 are too close to call (3 points apart, within the uncertainty), ahead on 3 of 4 shared core tests, at a similar price.

Test by testthird-party results

Claude Opus 4.8Claude Opus 4.7
0%25%50%75%100%REASONING & KNOWLEDGEGPQA Diamond (Epoch AI)GPQA Diamond (Epoch AI)LiveBench Data AnalysisLiveBench Data AnalysisLiveBench IFLiveBench IFLiveBench LanguageLiveBench LanguageLiveBench ReasoningLiveBench ReasoningGPQA Diamond (Vals AI)GPQA Diamond (Vals AI)MMLU ProMMLU ProMMMU ProMMMU ProEBR-benchEBR-benchSimpleBenchSimpleBenchSimpleQA VerifiedSimpleQA VerifiedMATHSFrontierMath (tiers 1-3)FrontierMath (tiers 1-3)AIME-style maths (OTIS mock)AIME-style maths (OTIS mock)LiveBench MathematicsLiveBench MathematicsChess puzzlesChess puzzlesFrontierMath (2025 set)FrontierMath (2025 set)FrontierMath tier 4 (2025 set)FrontierMath tier 4 (2025 set)FrontierMath (tier 4)FrontierMath (tier 4)CODINGLiveBench Agentic CodingLiveBench Agentic CodingLiveBench CodingLiveBench CodingCode MigrationCode MigrationLiveCodeBenchLiveCodeBenchProgramBenchProgramBenchSWE-benchSWE-benchVibe Code Bench v1.1Vibe Code Bench v1.1GSO-BenchGSO-BenchMirrorCodeMirrorCodeWeirdMLWeirdMLAGENTSAPEX-AgentsAPEX-AgentsDTBenchDTBenchFurniture assemblyFurniture assemblyLMCALMCAMystery game puzzlesMystery game puzzlesPROFESSIONAL WORKFinance Agent (v2)Finance Agent (v2)CorpFin v2CorpFin v2EMBEMBLegalBenchLegalBenchLegal Research BenchLegal Research BenchMedCodeMedCodeMedScribeMedScribeMortgageTaxMortgageTaxTax Agent BenchTax Agent BenchTaxEval v2TaxEval v2
Every result as a table
TestClaude Opus 4.8Claude Opus 4.7
Reasoning & knowledge
GPQA Diamond (Epoch AI)91.0%90.1%
LiveBench Data Analysis66.0%78.3%
LiveBench IF72.0%66.7%
LiveBench Language79.7%77.9%
LiveBench Reasoning89.2%87.2%
GPQA Diamond (Vals AI)92.4%90.1%
MMLU Pro89.6%89.9%
MMMU Pro86.6%85.5%
EBR-bench28.6%19.1%
SimpleBench64.8%61.7%
SimpleQA Verified53.0%51.7%
Maths
FrontierMath (tiers 1-3)80.0%70.2%
AIME-style maths (OTIS mock)98.3%97.8%
LiveBench Mathematics94.3%92.8%
Chess puzzles52.0%41.0%
FrontierMath (2025 set)47.2%43.8%
FrontierMath tier 4 (2025 set)31.3%22.9%
FrontierMath (tier 4)56.1%31.7%
Coding
LiveBench Agentic Coding50.5%50.7%
LiveBench Coding81.8%82.1%
Code Migration47.3%43.9%
LiveCodeBench87.8%85.1%
ProgramBench1.0%0.0%
SWE-bench88.6%82.0%
Vibe Code Bench v1.182.7%71.0%
GSO-Bench47.1%44.1%
MirrorCode65.6%43.3%
WeirdML82.9%76.4%
Agents
APEX-Agents48.9%49.2%
DTBench94.9%94.7%
Furniture assembly42.5%33.3%
LMCA57.5%52.2%
Mystery game puzzles36.0%28.0%
Professional work
Finance Agent (v2)53.9%51.5%
CorpFin v266.7%66.1%
EMB69.4%63.7%
LegalBench83.6%85.3%
Legal Research Bench43.8%38.5%
MedCode53.2%54.9%
MedScribe85.8%83.0%
MortgageTax69.9%70.3%
Tax Agent Bench30.0%23.7%
TaxEval v275.6%75.3%

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG