Best home rig for Nemotron 3 Nano Omni 30B
Will it fit my GPU? Best value GPU per euro →
Real, measured generation speeds for Nemotron 3 Nano Omni 30B on home hardware, fastest first. Different quants/engines aren't directly comparable.
| Build | Quant | Engine | tok/s | Cost | |
|---|---|---|---|---|---|
| Microsoft Surface Laptop Ultra (RTX Spark N1X): llama.cpp speeds on 2026 models (Micro Center) | general, short (~90-token) prompt | llama.cpp (Nvidia ARM64 build) | 63.9 | source | |
| DGX Spark (GB10, 128 GB): 23 models on vLLM at 128K context, Qwen3.6 35B-A3B up to 102 tok/s | vLLM 0.31.0, 128K ctx, 1 user | 58.8 | source |
Rent before you buy: try this model on a cloud GPU for a few dollars first: Runpod (referral link; sign up with Google to get the new-user bonus)
FAQ
What is the fastest measured hardware for Nemotron 3 Nano Omni 30B?
RTX Spark N1X: 63.9 tok/s generation (llama.cpp (Nvidia ARM64 build), general, short (~90-token) prompt), from https://www.microcenter.com/site/mc-news/article/benchmarking-the-rtx-spark.aspx.
Which GPUs have measured results for Nemotron 3 Nano Omni 30B?
DGX Spark (GB10), RTX Spark N1X.
Can it run on… DGX Spark (GB10) · RTX Spark N1X
Related: what GPU do you need for 2026 models · all builds