The Model Index
Up to four models

Mistral 7B v0.3 vs Llama 3.2 1B

On the index (GPT-4 = 100), Mistral 7B v0.3 scores 82 and Llama 3.2 1B 81. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to Mistral 7B v0.3
Presets
Mistral 7B v0.3
8261–102
WeightsOpen
ReleasedMay 2024
Price in / out–
Context–
Core tests taken1 of 9
Llama 3.2 1B
8139–124
WeightsOpen
ReleasedSep 2024
Price in / out$0.027 / $0.20
Context60K
Core tests taken1 of 9

Mistral 7B v0.3 and Llama 3.2 1B are too close to call (0 points apart, within the uncertainty), ahead on 0 of 1 shared core tests.

Test by testthird-party results

Mistral 7B v0.3Llama 3.2 1B
0%25%50%75%100%REASONING & KNOWLEDGEGPQA Diamond (Epoch AI)GPQA Diamond (Epoch AI)MATHSAIME-style maths (OTIS mock)AIME-style maths (OTIS mock)
Every result as a table
TestMistral 7B v0.3Llama 3.2 1B
Reasoning & knowledge
GPQA Diamond (Epoch AI)15.2%23.9%
Maths
AIME-style maths (OTIS mock)0.3%0.6%

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG