The Model Index
Up to four models

Llama 2-13B vs Mistral 7B v0.3

On the index (GPT-4 = 100), Llama 2-13B scores 87 and Mistral 7B v0.3 82. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to Llama 2-13B
Presets
Llama 2-13B
8771–104
WeightsOpen
ReleasedJul 2023
Price in / out–
Context–
Core tests taken0 of 9
Mistral 7B v0.3
8261–102
WeightsOpen
ReleasedMay 2024
Price in / out–
Context–
Core tests taken1 of 9

Llama 2-13B and Mistral 7B v0.3 are too close to call (6 points apart, within the uncertainty).

Test by testthird-party results

Llama 2-13BMistral 7B v0.3
0%25%50%75%100%REASONING & KNOWLEDGEMMLU (HELM runs)MMLU (HELM runs)AGENTSDTBenchDTBench
Every result as a table
TestLlama 2-13BMistral 7B v0.3
Reasoning & knowledge
MMLU (HELM runs)55.4%59.9%
Agents
DTBench42.2%42.5%

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG