Up to four models
Gemma 4 vs Claude Haiku 4.5
On the index (GPT-4 = 100), Gemma 4 scores 137 and Claude Haiku 4.5 137. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.
Claude Haiku 4.5
137121–153
WeightsClosed
ReleasedOct 2025
Price in / out$1.0 / $5.0
Context200K
Core tests taken3 of 9
Gemma 4 and Claude Haiku 4.5 are too close to call (1 point apart, within the uncertainty), ahead on 1 of 1 shared core tests.
Test by testthird-party results
Every result as a table
| Test | Gemma 4 | Claude Haiku 4.5 |
|---|---|---|
| Reasoning & knowledge | ||
| GPQA Diamond (Epoch AI) | 75.8% | 71.2% |
| SimpleQA Verified | 10.4% | 13.2% |
| Maths | ||
| AIME-style maths (OTIS mock) | 73.3% | 66.7% |
| Coding | ||
| WeirdML | 52.3% | 45.4% |
| Agents | ||
| DTBench | 82.7% | 73.6% |
| LMCA | 39.3% | 30.9% |
| Professional work | ||
| MortgageTax | 61.4% | 62.2% |
Tests at least two of these models have taken. Bold rows are the core tests.