The Model Index
Up to four models

o4-mini vs GPT-5.4 Nano

On the index (GPT-4 = 100), o4-mini scores 141 and GPT-5.4 Nano 141. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to o4-mini
Presets
o4-mini
141126–157
WeightsClosed
ReleasedApr 2025
Price in / out–
Context–
Core tests taken5 of 9
GPT-5.4 Nano
141125–157
WeightsClosed
ReleasedMar 2026
Price in / out$0.20 / $1.25
Context400K
Core tests taken4 of 9

o4-mini and GPT-5.4 Nano are too close to call (0 points apart, within the uncertainty), ahead on 2 of 3 shared core tests.

Test by testthird-party results

o4-miniGPT-5.4 Nano
0%25%50%75%100%REASONING & KNOWLEDGEGPQA Diamond (Epoch AI)GPQA Diamond (Epoch AI)GPQA Diamond (Vals AI)GPQA Diamond (Vals AI)MMLU ProMMLU ProMMMU ProMMMU ProSimpleQA VerifiedSimpleQA VerifiedMATHSFrontierMath (tiers 1-3)FrontierMath (tiers 1-3)AIME-style maths (OTIS mock)AIME-style maths (OTIS mock)Chess puzzlesChess puzzlesFrontierMath (2025 set)FrontierMath (2025 set)FrontierMath tier 4 (2025 set)FrontierMath tier 4 (2025 set)FrontierMath (tier 4)FrontierMath (tier 4)CODINGLiveCodeBenchLiveCodeBenchWeirdMLWeirdMLAGENTSDTBenchDTBenchLMCALMCAMystery game puzzlesMystery game puzzlesPROFESSIONAL WORKCorpFin v2CorpFin v2LegalBenchLegalBenchMedCodeMedCodeMedScribeMedScribeMortgageTaxMortgageTaxTaxEval v2TaxEval v2NOVEL PROBLEMSARC-AGI-2ARC-AGI-2ARC-AGI-1ARC-AGI-1
Every result as a table
Testo4-miniGPT-5.4 Nano
Reasoning & knowledge
GPQA Diamond (Epoch AI)79.6%78.5%
GPQA Diamond (Vals AI)74.5%77.5%
MMLU Pro80.6%77.2%
MMMU Pro79.7%73.6%
SimpleQA Verified19.6%11.7%
Maths
FrontierMath (tiers 1-3)36.1%44.9%
AIME-style maths (OTIS mock)81.7%87.8%
Chess puzzles22.0%45.0%
FrontierMath (2025 set)24.8%25.9%
FrontierMath tier 4 (2025 set)6.3%6.3%
FrontierMath (tier 4)4.9%12.2%
Coding
LiveCodeBench82.2%84.0%
WeirdML52.6%49.2%
Agents
DTBench77.6%80.3%
LMCA26.5%36.9%
Mystery game puzzles5.0%9.0%
Professional work
CorpFin v259.0%61.2%
LegalBench79.2%77.9%
MedCode33.8%41.0%
MedScribe69.1%77.1%
MortgageTax64.8%59.1%
TaxEval v274.8%67.4%
Novel problems
ARC-AGI-26.1%5.7%
ARC-AGI-158.7%51.5%
Task length · METR38 sec

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG