The Model Index
Up to four models

Gemini 1.0 Pro vs Mistral NeMo

On the index (GPT-4 = 100), Gemini 1.0 Pro scores 93 and Mistral NeMo 92. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to Gemini 1.0 Pro
Presets
Gemini 1.0 Pro
9375–111
WeightsClosed
ReleasedDec 2023
Price in / out–
Context–
Core tests taken1 of 9
Mistral NeMo
9274–110
WeightsOpen
ReleasedJul 2024
Price in / out$0.029 / $0.030
Context131K
Core tests taken1 of 9

Gemini 1.0 Pro and Mistral NeMo are too close to call (1 point apart, within the uncertainty), ahead on 1 of 1 shared core tests.

Test by testthird-party results

Gemini 1.0 ProMistral NeMo
0%25%50%75%100%REASONING & KNOWLEDGEGPQA Diamond (Epoch AI)GPQA Diamond (Epoch AI)MATHSMATH (level 5)MATH (level 5)AGENTSDTBenchDTBench
Every result as a table
TestGemini 1.0 ProMistral NeMo
Reasoning & knowledge
GPQA Diamond (Epoch AI)34.0%29.9%
Maths
MATH (level 5)11.2%10.8%
Agents
DTBench45.9%48.6%

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG