The Model Index
Up to four models

Qwen3.8-27B vs Gemini 3 Flash

On the index (GPT-4 = 100), Qwen3.8-27B scores 155 and Gemini 3 Flash 154. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to Qwen3.8-27B
Presets
Qwen3.8-27B
155139–171
WeightsOpen
ReleasedAug 2026
Price in / out$0.060 / $2.2
Context1.02M
Core tests taken3 of 9
Gemini 3 Flash
154139–170
WeightsClosed
ReleasedDec 2025
Price in / out$0.50 / $3.0
Context1.05M
Core tests taken5 of 9

Qwen3.8-27B and Gemini 3 Flash are too close to call (1 point apart, within the uncertainty), ahead on 2 of 2 shared core tests, and costs 1.9× less.

Test by testthird-party results

Qwen3.8-27BGemini 3 Flash
0%25%50%75%100%REASONING & KNOWLEDGEGPQA Diamond (Vals AI)GPQA Diamond (Vals AI)MMLU ProMMLU ProMMMU ProMMMU ProGeoBenchGeoBenchSimpleBenchSimpleBenchCODINGCode MigrationCode MigrationLiveCodeBenchLiveCodeBenchProgramBenchProgramBenchSWE-benchSWE-benchVibe Code Bench v1.1Vibe Code Bench v1.1AGENTSDTBenchDTBenchLMCALMCAPROFESSIONAL WORKFinance Agent (v2)Finance Agent (v2)EMBEMBLegalBenchLegalBenchLegal Research BenchLegal Research BenchMedCodeMedCodeMedScribeMedScribeMortgageTaxMortgageTaxTax Agent BenchTax Agent BenchTaxEval v2TaxEval v2NOVEL PROBLEMSARC-AGI-2ARC-AGI-2ARC-AGI-1ARC-AGI-1
Every result as a table
TestQwen3.8-27BGemini 3 Flash
Reasoning & knowledge
GPQA Diamond (Vals AI)88.9%87.9%
MMLU Pro84.3%88.6%
MMMU Pro83.9%87.6%
GeoBench38.0%88.0%
SimpleBench60.2%61.1%
Coding
Code Migration14.2%6.4%
LiveCodeBench84.0%85.6%
ProgramBench0.0%0.0%
SWE-bench86.0%75.0%
Vibe Code Bench v1.164.8%20.2%
Agents
DTBench88.0%89.1%
LMCA41.4%43.1%
Professional work
Finance Agent (v2)48.5%42.5%
EMB59.7%26.0%
LegalBench82.4%86.9%
Legal Research Bench36.1%18.3%
MedCode28.7%55.9%
MedScribe83.9%69.9%
MortgageTax64.9%68.7%
Tax Agent Bench30.9%11.8%
TaxEval v270.9%73.9%
Novel problems
ARC-AGI-242.4%33.6%
ARC-AGI-187.5%84.7%

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG