The Model Index
Up to four models

Qwen3.5 vs o4-mini

On the index (GPT-4 = 100), Qwen3.5 scores 144 and o4-mini 141. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to Qwen3.5
Presets
Qwen3.5
144127–161
WeightsOpen
ReleasedFeb 2026
Price in / out$0.45 / $3.0
Context262K
Core tests taken3 of 9
o4-mini
141126–157
WeightsClosed
ReleasedApr 2025
Price in / out–
Context–
Core tests taken5 of 9

Qwen3.5 and o4-mini are too close to call (2 points apart, within the uncertainty), ahead on 1 of 2 shared core tests.

Test by testthird-party results

Qwen3.5o4-mini
0%25%50%75%100%REASONING & KNOWLEDGEGPQA Diamond (Epoch AI)GPQA Diamond (Epoch AI)MATHSFrontierMath (tiers 1-3)FrontierMath (tiers 1-3)AIME-style maths (OTIS mock)AIME-style maths (OTIS mock)AGENTSDTBenchDTBenchLMCALMCAMystery game puzzlesMystery game puzzles
Every result as a table
TestQwen3.5o4-mini
Reasoning & knowledge
GPQA Diamond (Epoch AI)86.4%79.6%
Maths
FrontierMath (tiers 1-3)31.2%36.1%
AIME-style maths (OTIS mock)88.9%81.7%
Agents
DTBench87.5%77.6%
LMCA37.9%26.5%
Mystery game puzzles18.0%5.0%
Task length · METR38 sec

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG