Up to four models
Gemini 2.0 Flash Thinking (Jan 2025) vs Mistral Medium 3
On the index (GPT-4 = 100), Gemini 2.0 Flash Thinking (Jan 2025) scores 123 and Mistral Medium 3 120. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.
Next to Gemini 2.0 Flash Thinking (Jan 2025)
Presets
123107–139
WeightsClosed
ReleasedJan 2025
Price in / out–
Context–
Core tests taken2 of 9
120104–136
WeightsClosed
ReleasedMay 2025
Price in / out$0.44 / $2.2
Context131K
Core tests taken2 of 9
Gemini 2.0 Flash Thinking (Jan 2025) and Mistral Medium 3 are too close to call (3 points apart, within the uncertainty), ahead on 1 of 2 shared core tests.
Test by testthird-party results
Every result as a table
| Test | Gemini 2.0 Flash Thinking (Jan 2025) | Mistral Medium 3 |
|---|---|---|
| Reasoning & knowledge | ||
| GPQA Diamond (Epoch AI) | 57.1% | 59.5% |
| Humanity's Last Exam | 6.6% | 4.5% |
| Maths | ||
| AIME-style maths (OTIS mock) | 57.8% | 32.2% |
Tests at least two of these models have taken. Bold rows are the core tests.