Up to four models
Ministral 3B vs Mixtral 8x7B
On the index (GPT-4 = 100), Ministral 3B scores 93 and Mixtral 8x7B 91. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.
Ministral 3B and Mixtral 8x7B are too close to call (2 points apart, within the uncertainty), ahead on 0 of 1 shared core tests.
Test by testthird-party results
Every result as a table
| Test | Ministral 3B | Mixtral 8x7B |
|---|---|---|
| Reasoning & knowledge | ||
| GPQA Diamond (Epoch AI) | 25.3% | 30.6% |
| Maths | ||
| MATH (level 5) | 14.4% | 10.0% |
| Agents | ||
| DTBench | 51.7% | 49.6% |
Tests at least two of these models have taken. Bold rows are the core tests.