Up to four models
o4-mini vs Nemotron 3 Ultra
On the index (GPT-4 = 100), o4-mini scores 141 and Nemotron 3 Ultra 141. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.
141124–157
WeightsOpen
ReleasedJun 2026
Price in / out$0.50 / $2.2
Context262K
Core tests taken3 of 9
o4-mini and Nemotron 3 Ultra are too close to call (1 point apart, within the uncertainty), ahead on 0 of 1 shared core tests.
Test by testthird-party results
o4-mini
Nemotron 3 Ultra
Every result as a table
| Test | o4-mini | Nemotron 3 Ultra |
|---|---|---|
| Reasoning & knowledge | ||
| GPQA Diamond (Epoch AI) | 79.6% | 85.4% |
| GPQA Diamond (Vals AI) | 74.5% | 86.1% |
| MMLU Pro | 80.6% | 85.8% |
| SimpleBench | 38.7% | 41.7% |
| Maths | ||
| AIME-style maths (OTIS mock) | 81.7% | 86.7% |
| Coding | ||
| LiveCodeBench | 82.2% | 86.0% |
| WeirdML | 52.6% | 43.5% |
| Agents | ||
| DTBench | 77.6% | 90.1% |
| LMCA | 26.5% | 36.9% |
| Mystery game puzzles | 5.0% | 20.0% |
| Professional work | ||
| CorpFin v2 | 59.0% | 65.5% |
| LegalBench | 79.2% | 82.1% |
| MedCode | 33.8% | 38.6% |
| TaxEval v2 | 74.8% | 73.1% |
Task length · METR38 sec
Tests at least two of these models have taken. Bold rows are the core tests.