The Model Index
Up to four models

Qwen3-8B vs Claude 3.5 Sonnet

On the index (GPT-4 = 100), Qwen3-8B scores 126 and Claude 3.5 Sonnet 122. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to Qwen3-8B
Presets
Qwen3-8B
126110–141
WeightsOpen
ReleasedApr 2025
Price in / out–
Context–
Core tests taken1 of 9
Claude 3.5 Sonnet
122107–138
WeightsClosed
ReleasedOct 2024
Price in / out–
Context–
Core tests taken3 of 9

Qwen3-8B and Claude 3.5 Sonnet are too close to call (3 points apart, within the uncertainty), ahead on 1 of 1 shared core tests.

Test by testthird-party results

Qwen3-8BClaude 3.5 Sonnet
0%25%50%75%100%REASONING & KNOWLEDGEGPQA Diamond (Epoch AI)GPQA Diamond (Epoch AI)MATHSAIME-style maths (OTIS mock)AIME-style maths (OTIS mock)AGENTSDTBenchDTBench
Every result as a table
TestQwen3-8BClaude 3.5 Sonnet
Reasoning & knowledge
GPQA Diamond (Epoch AI)56.8%55.3%
Maths
AIME-style maths (OTIS mock)56.1%8.5%
Agents
DTBench59.7%67.8%
Task length · METR27 sec

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG