The Model Index
Up to four models

Mistral 7B vs Mistral 7B v0.3

On the index (GPT-4 = 100), Mistral 7B scores 93 and Mistral 7B v0.3 82. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to Mistral 7B
Presets
Mistral 7B
9377–109
WeightsOpen
ReleasedSep 2023
Price in / out–
Context–
Core tests taken0 of 9
Mistral 7B v0.3
8261–102
WeightsOpen
ReleasedMay 2024
Price in / out–
Context–
Core tests taken1 of 9

Mistral 7B and Mistral 7B v0.3 are too close to call (11 points apart, within the uncertainty).

Test by testthird-party results

Mistral 7BMistral 7B v0.3
0%25%50%75%100%REASONING & KNOWLEDGEMMLU (HELM runs)MMLU (HELM runs)
Every result as a table
TestMistral 7BMistral 7B v0.3
Reasoning & knowledge
MMLU (HELM runs)56.6%59.9%

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG