Builds / RTX 3090
RTX 3090 running Nemotron 3.5 Bolt 74B-A9B in 24 GB (IQ2)
Source: llm-speed.com ↗📏 How measured: reported by the original source; RigBase re-checked the numbers at that source
- GPU(s)
- RTX 3090
Amazon · eBay (used) · Newegg - VRAM / unified memory (GB)
- 24
- CPU
- not stated
- Motherboard
- not stated
- RAM
- not stated
- PSU
- not stated
- Other
- not stated
- Reported total cost
- not stated
- Power
- not stated
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s | Details |
|---|---|---|---|---|
| Nemotron 3.5 Bolt 74B-A9B | NVIDIA mixed 2-bit IQ2 GGUF (22.0 GB) | llama.cpp build 11669 (620d2225) | 87.75 | prefill 1,183.4 tok/scontext: 4K📏 Measured decode, llm-speed run |
Published 2026-10-16 by llm-speed. Rest of the system not stated by the source. Numbers re-read at the source on 2026-10-24.
Source: https://llm-speed.com/blog/nemotron-3-5-bolt-74b-24gb-measured
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: Runpod (referral link; sign up with Google to get the new-user bonus)
Quick answers: Can RTX 3090 run Nemotron 3.5 Bolt 74B-A9B?