The Model Index
Models/Mistral

Mistral Small v24.09

MistralReleased 17 Sep 2024Open weights
–Index scoreNo independent results yet
0/ 9Core tests taken0 of 6 areas · plus 1 anchor tests
–Versus the frontier at release
–Price per million tokensno public API price found
–Context windowtokens it reads at once

Where it sitson the frontier

801001201401601802002023202420252026GPT-4 at launch = 100

Not plotted: no independent score yet.

Test resultsby area · tick = best by any model

Reasoning & knowledgeno evidence yet
GPQA Diamond (Epoch AI)
no result
Humanity's Last Exam
no result
Mathsno evidence yet
FrontierMath (tiers 1-3)
no result
Codingno evidence yet
SWE-bench Verified
no result
Terminal-Bench 4.0
no result
Agentsevidence
APEX-Agents
no result
Professional workno evidence yet
Finance Agent (v2)
no result
Novel problemsno evidence yet
ARC-AGI-2
no result
Long tasksno evidence yet
METR time horizon
no result

Independent results from Epoch AI, Vals AI, LiveBench, ARC Prize, Scale AI and other testers, at the model’s best standard setting. The core tests are shown here; anchor tests also inform the score and can be shown above. Hover a bar for who ran it.

What others sayrank on each leaderboard

Not on any of the rankings we follow yet.

Further left is better. Leaderboards measure different things: LMArena is people voting blind between two answers, the others are test scores. Click any row for the source.

Best attop three among current models

Not in the top three among current models on any category we track.

Where this model places in the top three of today's models, on category leaderboards and on our core tests.

Facts and sources

Released17 Sep 2024
Announcementnot linked yet
Release entry–
Scored asMistral Small v24.09
Output speed–
Hugging Facenot linked

Mistral releasesaround this one