The Model Index
Up to four models

Qwen Plus (Jan 2025) vs Gemma 3

On the index (GPT-4 = 100), Qwen Plus (Jan 2025) scores 114 and Gemma 3 113. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to Qwen Plus (Jan 2025)
Presets
Qwen Plus (Jan 2025)
11498–131
WeightsClosed
ReleasedJan 2025
Price in / out$0.26 / $0.78
Context1M
Core tests taken1 of 9
Gemma 3
11397–129
WeightsOpen
ReleasedMar 2025
Price in / out$0.080 / $0.45
Context131K
Core tests taken1 of 9

Qwen Plus (Jan 2025) and Gemma 3 are too close to call (2 points apart, within the uncertainty), ahead on 1 of 1 shared core tests, at 2.3× the price.

Test by testthird-party results

Qwen Plus (Jan 2025)Gemma 3
0%25%50%75%100%REASONING & KNOWLEDGEGPQA Diamond (Epoch AI)GPQA Diamond (Epoch AI)MATHSAIME-style maths (OTIS mock)AIME-style maths (OTIS mock)MATH (level 5)MATH (level 5)
Every result as a table
TestQwen Plus (Jan 2025)Gemma 3
Reasoning & knowledge
GPQA Diamond (Epoch AI)48.1%47.7%
Maths
AIME-style maths (OTIS mock)17.8%22.5%
MATH (level 5)65.3%74.0%

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG