The Model Index
Up to four models

Magistral Small 1.2 vs Gemini 1.5 Pro (Sept 2024)

On the index (GPT-4 = 100), Magistral Small 1.2 scores 117 and Gemini 1.5 Pro (Sept 2024) 117. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to Magistral Small 1.2
Presets
Magistral Small 1.2
117101–133
WeightsOpen
ReleasedSep 2025
Price in / out–
Context–
Core tests taken1 of 9
Gemini 1.5 Pro (Sept 2024)
117101–133
WeightsClosed
ReleasedSep 2024
Price in / out–
Context–
Core tests taken2 of 9

Magistral Small 1.2 and Gemini 1.5 Pro (Sept 2024) are too close to call (0 points apart, within the uncertainty), ahead on 0 of 1 shared core tests.

Test by testthird-party results

Magistral Small 1.2Gemini 1.5 Pro (Sept 2024)
0%25%50%75%100%REASONING & KNOWLEDGEGPQA Diamond (Epoch AI)GPQA Diamond (Epoch AI)MATHSAIME-style maths (OTIS mock)AIME-style maths (OTIS mock)AGENTSDTBenchDTBench
Every result as a table
TestMagistral Small 1.2Gemini 1.5 Pro (Sept 2024)
Reasoning & knowledge
GPQA Diamond (Epoch AI)47.6%57.2%
Maths
AIME-style maths (OTIS mock)28.1%23.1%
Agents
DTBench61.3%59.0%

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG