Up to four models
Qwen 3.5 Plus (hosted 397B-A17B) vs Nemotron 3 Ultra
On the index (GPT-4 = 100), Qwen 3.5 Plus (hosted 397B-A17B) scores 141 and Nemotron 3 Ultra 141. Side by side on the same third-party tests, with price and context. The link in your address bar shares this exact comparison.
141124–158
WeightsClosed
ReleasedFeb 2026
Price in / out–
Context–
Core tests taken1 of 9
141124–157
WeightsOpen
ReleasedJun 2026
Price in / out$0.50 / $2.2
Context262K
Core tests taken3 of 9
Qwen 3.5 Plus (hosted 397B-A17B) and Nemotron 3 Ultra are too close to call (0 points apart, within the uncertainty), ahead on 0 of 1 shared core tests.
Test by testthird-party results
Every result as a table
| Test | Qwen 3.5 Plus (hosted 397B-A17B) | Nemotron 3 Ultra |
|---|---|---|
| Reasoning & knowledge | ||
| GPQA Diamond (Epoch AI) | 84.9% | 85.4% |
| GPQA Diamond (Vals AI) | 87.4% | 86.1% |
| MMLU Pro | 87.2% | 85.8% |
| Maths | ||
| AIME-style maths (OTIS mock) | 86.7% | 86.7% |
| Coding | ||
| LiveCodeBench | 85.3% | 86.0% |
| SWE-bench | 71.2% | 69.0% |
| Vibe Code Bench v1.1 | 15.7% | 7.6% |
| Agents | ||
| DTBench | 80.5% | 90.1% |
| LMCA | 36.4% | 36.9% |
| Mystery game puzzles | 17.0% | 20.0% |
| Professional work | ||
| CorpFin v2 | 65.3% | 65.5% |
| LegalBench | 85.1% | 82.1% |
Tests at least two of these models have taken. Bold rows are the core tests.