Up to four models
GPT-5.6 Sol vs Kimi K3.1 Pro
On the index (GPT-4 = 100), GPT-5.6 Sol scores 179 and Kimi K3.1 Pro 179. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.
GPT-5.6 Sol
179164–195
WeightsClosed
ReleasedJul 2026
Price in / out$4.0 / $20
Context1.05M
Core tests taken5 of 9
Kimi K3.1 Pro
179163–195
WeightsOpen
ReleasedOct 2026
Price in / out$0.24 / $8.4
Context1.05M
Core tests taken4 of 9
GPT-5.6 Sol and Kimi K3.1 Pro are too close to call (0 points apart, within the uncertainty), ahead on 1 of 3 shared core tests, at 3.5× the price.
Test by testthird-party results
GPT-5.6 SolKimi K3.1 Pro
Every result as a table
| Test | GPT-5.6 Sol | Kimi K3.1 Pro |
|---|---|---|
| Reasoning & knowledge | ||
| GPQA Diamond (Epoch AI) | 93.5% | 94.2% |
| SimpleQA Verified | 69.7% | 62.2% |
| Maths | ||
| FrontierMath (tiers 1-3) | 89.1% | 78.3% |
| AIME-style maths (OTIS mock) | 100.0% | 100.0% |
| ProofBench v1.1 | 83.0% | 91.0% |
| Chess puzzles | 59.0% | 45.0% |
| FrontierMath (tier 4) | 82.9% | 65.8% |
| Coding | ||
| Terminal-Bench 4.0 | 37.9% | 63.6% |
| IOI | 91.2% | 81.9% |
| Vibe Code Bench v1.1 | 80.5% | 84.9% |
| Agents | ||
| BioMysteryBench | 71.1% | 75.6% |
| SRE Bench | 30.5% | 27.1% |
| Terminal-Bench-Science | 20.0% | 31.4% |
| DTBench | 95.7% | 93.3% |
| Furniture assembly | 56.7% | 55.8% |
| LMCA | 58.5% | 57.6% |
| Mystery game puzzles | 58.0% | 42.0% |
| Professional work | ||
| Legal Research Bench | 48.1% | 37.5% |
| Tax Agent Bench | 31.1% | 24.9% |
| Novel problems | ||
| MysteryMechanism | 33.3% | 26.1% |
Tests at least two of these models have taken. Bold rows are the core tests.