The Model Index
Up to four models

GLM-5.1 vs GPT-5.4 Nano

On the index (GPT-4 = 100), GLM-5.1 scores 151 and GPT-5.4 Nano 141. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to GLM-5.1
Presets
GLM-5.1
151134–167
WeightsOpen
ReleasedApr 2026
Price in / out$1.4 / $4.4
Context205K
Core tests taken5 of 9
GPT-5.4 Nano
141125–157
WeightsClosed
ReleasedMar 2026
Price in / out$0.20 / $1.25
Context400K
Core tests taken4 of 9

GLM-5.1 leads GPT-5.4 Nano by 9 points, ahead on 2 of 3 shared core tests, at 4.6× the price.

Test by testthird-party results

GLM-5.1GPT-5.4 Nano
0%25%50%75%100%REASONING & KNOWLEDGEGPQA Diamond (Epoch AI)GPQA Diamond (Epoch AI)GPQA Diamond (Vals AI)GPQA Diamond (Vals AI)MMLU ProMMLU ProSimpleQA VerifiedSimpleQA VerifiedMATHSFrontierMath (tiers 1-3)FrontierMath (tiers 1-3)AIME-style maths (OTIS mock)AIME-style maths (OTIS mock)Chess puzzlesChess puzzlesFrontierMath (2025 set)FrontierMath (2025 set)FrontierMath tier 4 (2025 set)FrontierMath tier 4 (2025 set)CODINGCode MigrationCode MigrationLiveCodeBenchLiveCodeBenchSWE-benchSWE-benchVibe Code Bench v1.1Vibe Code Bench v1.1WeirdMLWeirdMLPROFESSIONAL WORKFinance Agent (v2)Finance Agent (v2)CorpFin v2CorpFin v2LegalBenchLegalBenchLegal Research BenchLegal Research BenchMedCodeMedCodeMedScribeMedScribeTaxEval v2TaxEval v2
Every result as a table
TestGLM-5.1GPT-5.4 Nano
Reasoning & knowledge
GPQA Diamond (Epoch AI)89.9%78.5%
GPQA Diamond (Vals AI)84.5%77.5%
MMLU Pro86.9%77.2%
SimpleQA Verified34.0%11.7%
Maths
FrontierMath (tiers 1-3)36.8%44.9%
AIME-style maths (OTIS mock)93.3%87.8%
Chess puzzles20.0%45.0%
FrontierMath (2025 set)33.5%25.9%
FrontierMath tier 4 (2025 set)12.5%6.3%
Coding
Code Migration25.8%14.5%
LiveCodeBench81.4%84.0%
SWE-bench76.4%69.8%
Vibe Code Bench v1.131.5%26.1%
WeirdML57.1%49.2%
Professional work
Finance Agent (v2)44.8%38.2%
CorpFin v264.5%61.2%
LegalBench84.4%77.9%
Legal Research Bench27.9%6.3%
MedCode41.6%41.0%
MedScribe72.3%77.1%
TaxEval v271.2%67.4%

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG