RTX 5090 (llm-speed signed runs, Oct 2026): gpt-oss 20B 324 tok/s, Qwen3.8 27B 75 tok/s
| GPU(s) | RTX 5090 Amazon · eBay (used) · Newegg |
|---|---|
| VRAM / unified memory (GB) | 32 |
| CPU | AMD EPYC 7543 (Qwen3.8 run: EPYC 9534) Amazon · eBay (used) · Newegg |
| Motherboard | |
| RAM | |
| PSU | |
| Other | Server hosts; llm-speed suite-v1 chat-short workload (128-token prompt, 256 tokens out, batch 1) |
| Reported total cost | |
| Power |
Measured speed (generation tokens/sec)
📏 How measured: reported by the original source; RigBase re-checked the numbers at that source
| Model | Quant | Engine | tok/s | Details |
|---|---|---|---|---|
| gpt-oss 20B | reported as Q4_K_M | llama.cpp 0.7.0-dev | 324.2 | |
| Qwen3.6 27B | Q4_K_M | llama.cpp 0.7.0-dev | 75.1 | |
| Qwen3.8 27B | Q4_K_M (EPYC 9534 host) | llama.cpp 0.7.0-dev (b11669) | 75.2 |
Signed community runs on llm-speed.com, 15-17 Oct 2026. Decode tok/s from the chat-short workload; the chat-long (4K prompt) runs were 311.0 (gpt-oss 20B), 74.5 (Qwen3.6 27B) and 74.6 (Qwen3.8 27B). Signing records provenance, not independent hardware verification.
Current GPU street price (estimate, not the builder's cost)
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
- 1× RTX 5090: ≈€6,199 each (≈$6,948), new, approx. price as of 2026-10-16, lowest listing on billiger.de (Asus GeForce RTX 5090 (lowest variant))
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.
Source: https://llm-speed.com/r/r_dwp5fgdapmw
https://llm-speed.com/r/r_pob-co51bd-
https://llm-speed.com/r/r_qfrb2zmyk0k
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: Runpod (referral link; sign up with Google to get the new-user bonus)
Quick answers: Can RTX 5090 run Qwen3.6 27B? · Can RTX 5090 run Qwen3.8 27B? · Can RTX 5090 run gpt-oss 20B?