Up to four models
GPT-6 Astra vs Claude Sonnet 5.5
On the index (GPT-4 = 100), GPT-6 Astra scores 199 and Claude Sonnet 5.5 191. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.
GPT-6 Astra
199182–215
WeightsClosed
ReleasedSep 2026
Price in / out$10 / $50
Context1.05M
Core tests taken7 of 9
Claude Sonnet 5.5
191175–207
WeightsClosed
ReleasedSep 2026
Price in / out$2.0 / $10
Context1M
Core tests taken7 of 9
GPT-6 Astra leads Claude Sonnet 5.5 by 8 points, ahead on 4 of 7 shared core tests, at 5.0× the price.
Test by testthird-party results
GPT-6 AstraClaude Sonnet 5.5
Every result as a table
| Test | GPT-6 Astra | Claude Sonnet 5.5 |
|---|---|---|
| Reasoning & knowledge | ||
| GPQA Diamond (Epoch AI) | 95.8% | 95.6% |
| Humanity's Last Exam | 54.8% | 46.1% |
| LiveBench Data Analysis | 83.0% | 78.6% |
| LiveBench IF | 75.6% | 70.5% |
| LiveBench Language | 89.4% | 83.4% |
| LiveBench Reasoning | 92.7% | 91.6% |
| SimpleQA Verified | 75.6% | 46.5% |
| Maths | ||
| FrontierMath (tiers 1-3) | 93.7% | 88.8% |
| AIME-style maths (OTIS mock) | 100.0% | 100.0% |
| LiveBench Mathematics | 96.8% | 96.7% |
| ProofBench v1.1 | 99.0% | 100.0% |
| Chess puzzles | 74.0% | 59.0% |
| FrontierMath (tier 4) | 97.6% | 80.5% |
| Coding | ||
| Terminal-Bench 4.0 | 59.6% | 64.1% |
| LiveBench Agentic Coding | 57.3% | 56.3% |
| LiveBench Coding | 80.4% | 91.4% |
| Code Migration | 67.7% | 69.8% |
| CyberBench v1.1 | 41.1% | 59.6% |
| IOI | 100.0% | 83.1% |
| ProgramBench | 5.5% | 6.5% |
| Vibe Code Bench v1.1 | 89.6% | 92.4% |
| FrontierSWE | 65.5% | 61.9% |
| Agents | ||
| APEX-Agents | 64.7% | 75.5% |
| BioMysteryBench | 79.3% | 81.1% |
| SRE Bench | 56.9% | 30.1% |
| Terminal-Bench-Science | 62.9% | 47.1% |
| DTBench | 97.3% | 97.3% |
| Furniture assembly | 80.0% | 75.0% |
| LMCA | 64.4% | 68.3% |
| Mystery game puzzles | 84.0% | 65.0% |
| Professional work | ||
| Finance Agent (v2) | 53.5% | 58.1% |
| EMB | 71.7% | 75.7% |
| HLAB-Vals-1.1 | 7.1% | 10.4% |
| Legal Research Bench | 39.4% | 48.1% |
| MedCode | 48.5% | 52.9% |
| MedScribe | 87.9% | 91.1% |
| SAGE | 46.4% | 51.8% |
| Tax Agent Bench | 20.7% | 42.0% |
| Novel problems | ||
| ARC-AGI-2 | 95.0% | 83.9% |
| ARC-AGI-1 | 98.5% | 96.5% |
| ARC-AGI-3 | 62.7% | 24.3% |
| MysteryMechanism | 53.1% | 49.1% |
Tests at least two of these models have taken. Bold rows are the core tests.
