RTX 4090 (llm-speed signed runs, Oct 2026): Qwen3.6 35B-A3B 161 tok/s, Gemma 4 12B QAT 98 tok/s
| GPU(s) | RTX 4090 Amazon · eBay (used) · Newegg |
|---|---|
| VRAM / unified memory (GB) | 24 |
| CPU | AMD EPYC 7642 (GLM run: EPYC 75F3) Amazon · eBay (used) · Newegg |
| Motherboard | |
| RAM | |
| PSU | |
| Other | Server hosts; llm-speed suite-v1 chat-short workload (128-token prompt, 256 tokens out, batch 1) |
| Reported total cost | |
| Power |
Measured speed (generation tokens/sec)
📏 How measured: reported by the original source; RigBase re-checked the numbers at that source
| Model | Quant | Engine | tok/s | Details |
|---|---|---|---|---|
| Qwen3.6 35B-A3B | Q4_K_M | llama.cpp b8931 | 160.6 | |
| Gemma 4 12B | QAT Q4_0 | llama.cpp b8931 | 97.7 | |
| GLM 4.7 Flash | Q4_K_M (EPYC 75F3 host) | Ollama 0.31.1 | 164.9 |
Signed community runs on llm-speed.com, 16 Oct 2026. Decode tok/s from the chat-short workload; chat-long (4K prompt): 160.4 (Qwen3.6 35B-A3B), 86.3 (Gemma 4 12B), 146.1 (GLM 4.7 Flash).
Current GPU street price (estimate, not the builder's cost)
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
- 1× RTX 4090: ≈€3,955 each (≈$4,433), new, approx. price as of 2026-10-16, lowest listing on billiger.de (ASUS TUF Gaming RTX 4090 OG OC 24 GB)
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
Source: https://llm-speed.com/r/r_m6j1zxwvp-f
https://llm-speed.com/r/r_jfh0qkngw76
https://llm-speed.com/r/r_ted0u8uyre0
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: Runpod (referral link; sign up with Google to get the new-user bonus)
Quick answers: Can RTX 4090 run GLM 4.7 Flash? · Can RTX 4090 run Gemma 4 12B? · Can RTX 4090 run Qwen3.6 35B-A3B?