Up to four models
Grok 4 Fast vs o4-mini
On the index (GPT-4 = 100), Grok 4 Fast scores 143 and o4-mini 141. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.
Grok 4 Fast and o4-mini are too close to call (1 point apart, within the uncertainty).
Test by testthird-party results
Grok 4 Fasto4-mini
Every result as a table
| Test | Grok 4 Fast | o4-mini |
|---|---|---|
| Reasoning & knowledge | ||
| GPQA Diamond (Vals AI) | 85.4% | 74.5% |
| MMLU Pro | 79.7% | 80.6% |
| MMMU Pro | 72.8% | 79.7% |
| Fiction.LiveBench | 94.4% | 77.8% |
| Maths | ||
| MGSM | 90.9% | 93.4% |
| Coding | ||
| LiveCodeBench | 79.0% | 82.2% |
| WeirdML | 42.9% | 52.6% |
| Agents | ||
| DTBench | 82.7% | 77.6% |
| Professional work | ||
| CorpFin v2 | 66.9% | 59.0% |
| LegalBench | 80.6% | 79.2% |
| MedCode | 37.4% | 33.8% |
| MedScribe | 81.6% | 69.1% |
| MortgageTax | 42.1% | 64.8% |
| TaxEval v2 | 75.7% | 74.8% |
Task length · METR38 sec
Tests at least two of these models have taken. Bold rows are the core tests.