The Model Index
Up to four models

Gemini 1.5 Flash 8B vs Qwen2.5-7B

On the index (GPT-4 = 100), Gemini 1.5 Flash 8B scores 99 and Qwen2.5-7B 96. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to Gemini 1.5 Flash 8B
Presets
Gemini 1.5 Flash 8B
9977–120
WeightsClosed
ReleasedOct 2024
Price in / out–
Context–
Core tests taken1 of 9
Qwen2.5-7B
9677–115
WeightsOpen
ReleasedSep 2024
Price in / out–
Context–
Core tests taken1 of 9

Gemini 1.5 Flash 8B and Qwen2.5-7B are too close to call (3 points apart, within the uncertainty), ahead on 0 of 1 shared core tests.

Test by testthird-party results

Gemini 1.5 Flash 8BQwen2.5-7B
0%25%50%75%100%REASONING & KNOWLEDGEGPQA Diamond (Epoch AI)GPQA Diamond (Epoch AI)MATHSAIME-style maths (OTIS mock)AIME-style maths (OTIS mock)AGENTSDTBenchDTBench
Every result as a table
TestGemini 1.5 Flash 8BQwen2.5-7B
Reasoning & knowledge
GPQA Diamond (Epoch AI)33.0%35.5%
Maths
AIME-style maths (OTIS mock)4.6%2.5%
Agents
DTBench50.0%47.7%

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG