Up to four models
Kimi K3 vs Claude Sonnet 5
On the index (GPT-4 = 100), Kimi K3 scores 168 and Claude Sonnet 5 164. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.
Kimi K3
168152–183
WeightsOpen
ReleasedJul 2026
Price in / out$0.19 / $16
Context1.05M
Core tests taken6 of 9
Claude Sonnet 5
164148–180
WeightsClosed
ReleasedJun 2026
Price in / out$2.0 / $10
Context1M
Core tests taken5 of 9
Kimi K3 and Claude Sonnet 5 are too close to call (3 points apart, within the uncertainty), ahead on 3 of 5 shared core tests, at a similar price.
Test by testthird-party results
Kimi K3Claude Sonnet 5
Every result as a table
| Test | Kimi K3 | Claude Sonnet 5 |
|---|---|---|
| Reasoning & knowledge | ||
| GPQA Diamond (Epoch AI) | 93.1% | 90.5% |
| LiveBench Data Analysis | 78.7% | 71.7% |
| LiveBench IF | 71.4% | 63.9% |
| LiveBench Language | 85.5% | 75.0% |
| LiveBench Reasoning | 90.7% | 88.7% |
| GPQA Diamond (Vals AI) | 92.9% | 88.9% |
| MMLU Pro | 88.0% | 87.5% |
| MMMU Pro | 88.1% | 83.0% |
| SimpleBench | 60.7% | 60.6% |
| SimpleQA Verified | 50.6% | 33.7% |
| Maths | ||
| FrontierMath (tiers 1-3) | 72.2% | 65.6% |
| AIME-style maths (OTIS mock) | 97.2% | 94.7% |
| LiveBench Mathematics | 84.4% | 92.9% |
| ProofBench v1.1 | 87.0% | 77.0% |
| Chess puzzles | 37.0% | 45.0% |
| FrontierMath (tier 4) | 39.0% | 29.3% |
| Surface Evolver Bench | 95.0% | 60.0% |
| Coding | ||
| Terminal-Bench 4.0 | 17.2% | 10.6% |
| LiveBench Agentic Coding | 62.2% | 59.4% |
| LiveBench Coding | 81.5% | 80.7% |
| Code Migration | 16.1% | 44.4% |
| CyberBench v1.1 | 75.2% | 70.3% |
| IOI | 48.9% | 45.0% |
| LiveCodeBench | 87.2% | 82.4% |
| ProgramBench | 2.0% | 0.0% |
| SWE-bench | 93.4% | 79.6% |
| Vibe Code Bench 1-100 | 18.2% | 13.8% |
| Vibe Code Bench v1.1 | 85.0% | 81.3% |
| DeepSWE | 68.5% | 53.8% |
| MirrorCode | 54.4% | 63.3% |
| WeirdML | 82.6% | 69.0% |
| Agents | ||
| APEX-Agents | 47.8% | 54.5% |
| Terminal-Bench-Science | 1.4% | 5.7% |
| DTBench | 91.2% | 92.5% |
| LMCA | 52.7% | 50.0% |
| Mystery game puzzles | 26.0% | 35.0% |
| Professional work | ||
| Finance Agent (v2) | 53.1% | 53.9% |
| CorpFin v2 | 71.6% | 67.0% |
| EMB | 66.7% | 66.3% |
| LegalBench | 86.2% | 83.9% |
| Legal Research Bench | 46.2% | 41.8% |
| MedCode | 49.4% | 47.5% |
| MedScribe | 88.0% | 76.0% |
| MortgageTax | 66.3% | 70.0% |
| Public Benefits Bench v1.1 | 68.2% | 66.0% |
| Tax Agent Bench | 33.4% | 29.4% |
| TaxEval v2 | 75.7% | 75.6% |
Tests at least two of these models have taken. Bold rows are the core tests.