The Model Index
Up to four models

GPT-6 Astra vs Qwen3.8-27B

On the index (GPT-4 = 100), GPT-6 Astra scores 193 and Qwen3.8-27B 155. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to GPT-6 Astra
Presets
GPT-6 Astra
193178–209
WeightsClosed
ReleasedSep 2026
Price in / out$10 / $50
Context1.05M
Core tests taken7 of 9
Qwen3.8-27B
155139–171
WeightsOpen
ReleasedAug 2026
Price in / out$0.060 / $2.2
Context1.02M
Core tests taken3 of 9

GPT-6 Astra leads Qwen3.8-27B by 38 points, ahead on 3 of 3 shared core tests, at 34× the price.

Test by testthird-party results

GPT-6 AstraQwen3.8-27B
0%25%50%75%100%REASONING & KNOWLEDGELiveBench Data AnalysisLiveBench Data AnalysisLiveBench IFLiveBench IFLiveBench LanguageLiveBench LanguageLiveBench ReasoningLiveBench ReasoningSimpleBenchSimpleBenchMATHSLiveBench MathematicsLiveBench MathematicsProofBench v1.1ProofBench v1.1CODINGLiveBench Agentic CodingLiveBench Agentic CodingLiveBench CodingLiveBench CodingCode MigrationCode MigrationCyberBench v1.1CyberBench v1.1IOIIOIProgramBenchProgramBenchVibe Code Bench v1.1Vibe Code Bench v1.1AGENTSAPEX-AgentsAPEX-AgentsTerminal-Bench-ScienceTerminal-Bench-ScienceDTBenchDTBenchLMCALMCAPROFESSIONAL WORKFinance Agent (v2)Finance Agent (v2)EMBEMBLegal Research BenchLegal Research BenchMedCodeMedCodeMedScribeMedScribeTax Agent BenchTax Agent BenchNOVEL PROBLEMSARC-AGI-2ARC-AGI-2ARC-AGI-1ARC-AGI-1
Every result as a table
TestGPT-6 AstraQwen3.8-27B
Reasoning & knowledge
LiveBench Data Analysis83.0%76.6%
LiveBench IF75.6%72.7%
LiveBench Language89.4%74.4%
LiveBench Reasoning92.7%80.0%
SimpleBench83.6%60.2%
Maths
LiveBench Mathematics96.8%86.2%
ProofBench v1.199.0%16.0%
Coding
LiveBench Agentic Coding57.3%61.4%
LiveBench Coding80.4%75.7%
Code Migration67.7%14.2%
CyberBench v1.141.1%67.8%
IOI100.0%39.1%
ProgramBench5.5%0.0%
Vibe Code Bench v1.189.6%64.8%
Agents
APEX-Agents64.7%47.5%
Terminal-Bench-Science62.9%0.0%
DTBench97.3%88.0%
LMCA64.4%41.4%
Professional work
Finance Agent (v2)53.5%48.5%
EMB71.7%59.7%
Legal Research Bench39.4%36.1%
MedCode48.5%28.7%
MedScribe87.9%83.9%
Tax Agent Bench20.7%30.9%
Novel problems
ARC-AGI-295.0%42.4%
ARC-AGI-198.5%87.5%

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG