Up to four models
Gemini 1.0 Pro vs Ministral 8B
On the index (GPT-4 = 100), Gemini 1.0 Pro scores 93 and Ministral 8B 93. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.
Gemini 1.0 Pro and Ministral 8B are too close to call (0 points apart, within the uncertainty), ahead on 1 of 1 shared core tests.
Test by testthird-party results
Every result as a table
| Test | Gemini 1.0 Pro | Ministral 8B |
|---|---|---|
| Reasoning & knowledge | ||
| GPQA Diamond (Epoch AI) | 34.0% | 27.2% |
| Maths | ||
| MATH (level 5) | 11.2% | 14.9% |
| Agents | ||
| DTBench | 45.9% | 45.7% |
Tests at least two of these models have taken. Bold rows are the core tests.