Up to four models
Llama 3.2 vs Qwen2
On the index (GPT-4 = 100), Llama 3.2 scores 106 and Qwen2 106. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.
Llama 3.2 and Qwen2 are too close to call (0 points apart, within the uncertainty), ahead on 1 of 1 shared core tests.
Test by testthird-party results
Every result as a table
| Test | Llama 3.2 | Qwen2 |
|---|---|---|
| Reasoning & knowledge | ||
| GPQA Diamond (Epoch AI) | 41.0% | 40.8% |
| MMLU (HELM runs) | 80.3% | 82.4% |
| Maths | ||
| MATH (level 5) | 39.4% | 39.1% |
Task length · METR
18 sec
Tests at least two of these models have taken. Bold rows are the core tests.