The Model Index
Up to four models

GPT-5.6 Sol vs Kimi K3

On the index (GPT-4 = 100), GPT-5.6 Sol scores 179 and Kimi K3 168. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.

Next to GPT-5.6 Sol
Presets
GPT-5.6 Sol
179164–195
WeightsClosed
ReleasedJul 2026
Price in / out$4.0 / $20
Context1.05M
Core tests taken5 of 9
Kimi K3
168152–183
WeightsOpen
ReleasedJul 2026
Price in / out$0.19 / $16
Context1.05M
Core tests taken6 of 9

GPT-5.6 Sol leads Kimi K3 by 12 points, ahead on 5 of 5 shared core tests, at 1.9× the price.

Test by testthird-party results

GPT-5.6 SolKimi K3
0%25%50%75%100%REASONING & KNOWLEDGEGPQA Diamond (Epoch AI)GPQA Diamond (Epoch AI)LiveBench Data AnalysisLiveBench Data AnalysisLiveBench IFLiveBench IFLiveBench LanguageLiveBench LanguageLiveBench ReasoningLiveBench ReasoningGPQA Diamond (Vals AI)GPQA Diamond (Vals AI)MMLU ProMMLU ProMMMU ProMMMU ProSimpleBenchSimpleBenchSimpleQA VerifiedSimpleQA VerifiedMATHSFrontierMath (tiers 1-3)FrontierMath (tiers 1-3)AIME-style maths (OTIS mock)AIME-style maths (OTIS mock)LiveBench MathematicsLiveBench MathematicsProofBench v1.1ProofBench v1.1Chess puzzlesChess puzzlesFrontierMath (tier 4)FrontierMath (tier 4)Surface Evolver BenchSurface Evolver BenchCODINGTerminal-Bench 4.0Terminal-Bench 4.0LiveBench Agentic CodingLiveBench Agentic CodingLiveBench CodingLiveBench CodingCode MigrationCode MigrationCyberBench v1.1CyberBench v1.1IOIIOILiveCodeBenchLiveCodeBenchProgramBenchProgramBenchSWE-benchSWE-benchVibe Code Bench 1-100Vibe Code Bench 1-100Vibe Code Bench v1.1Vibe Code Bench v1.1DeepSWEDeepSWEFrontierSWEFrontierSWEMirrorCodeMirrorCodeWeirdMLWeirdMLAGENTSBioMysteryBenchBioMysteryBenchTerminal-Bench-ScienceTerminal-Bench-ScienceDTBenchDTBenchFurniture assemblyFurniture assemblyLMCALMCAMystery game puzzlesMystery game puzzlesPROFESSIONAL WORKFinance Agent (v2)Finance Agent (v2)CorpFin v2CorpFin v2EMBEMBLegalBenchLegalBenchLegal Research BenchLegal Research BenchMedCodeMedCodeMedScribeMedScribeMortgageTaxMortgageTaxPublic Benefits Bench v1.1Public Benefits Bench v1.1Tax Agent BenchTax Agent BenchTaxEval v2TaxEval v2NOVEL PROBLEMSARC-AGI-2ARC-AGI-2ARC-AGI-1ARC-AGI-1
Every result as a table
TestGPT-5.6 SolKimi K3
Reasoning & knowledge
GPQA Diamond (Epoch AI)93.5%93.1%
LiveBench Data Analysis79.8%78.7%
LiveBench IF71.9%71.4%
LiveBench Language87.7%85.5%
LiveBench Reasoning91.6%90.7%
GPQA Diamond (Vals AI)95.2%92.9%
MMLU Pro89.1%88.0%
MMMU Pro88.8%88.1%
SimpleBench64.8%60.7%
SimpleQA Verified69.7%50.6%
Maths
FrontierMath (tiers 1-3)89.1%72.2%
AIME-style maths (OTIS mock)100.0%97.2%
LiveBench Mathematics96.2%84.4%
ProofBench v1.183.0%87.0%
Chess puzzles59.0%37.0%
FrontierMath (tier 4)82.9%39.0%
Surface Evolver Bench93.1%95.0%
Coding
Terminal-Bench 4.037.9%17.2%
LiveBench Agentic Coding56.2%62.2%
LiveBench Coding83.9%81.5%
Code Migration52.9%16.1%
CyberBench v1.176.3%75.2%
IOI91.2%48.9%
LiveCodeBench82.6%87.2%
ProgramBench1.5%2.0%
SWE-bench96.2%93.4%
Vibe Code Bench 1-10020.0%18.2%
Vibe Code Bench v1.180.5%85.0%
DeepSWE72.7%68.5%
FrontierSWE32.2%25.9%
MirrorCode20.0%54.4%
WeirdML88.8%82.6%
Agents
BioMysteryBench71.1%72.6%
Terminal-Bench-Science20.0%1.4%
DTBench95.7%91.2%
Furniture assembly56.7%34.2%
LMCA58.5%52.7%
Mystery game puzzles58.0%26.0%
Professional work
Finance Agent (v2)53.8%53.1%
CorpFin v264.4%71.6%
EMB72.3%66.7%
LegalBench87.0%86.2%
Legal Research Bench48.1%46.2%
MedCode44.0%49.4%
MedScribe85.2%88.0%
MortgageTax67.3%66.3%
Public Benefits Bench v1.166.5%68.2%
Tax Agent Bench31.1%33.4%
TaxEval v274.8%75.7%
Novel problems
ARC-AGI-292.5%60.4%
ARC-AGI-197.5%94.5%

Tests at least two of these models have taken. Bold rows are the core tests.

This page as a chartDownload PNG