RTX 4090: 2026 models (llamabench community)

Name: RTX 4090: 2026 models (llamabench community)
Creator: RigBase
License: https://creativecommons.org/licenses/by/4.0/

GPU(s)	RTX 4090 Amazon · eBay (used) · Newegg
VRAM / unified memory (GB)	24
CPU
Motherboard
RAM
PSU
Other
Reported total cost
Power

Measured speed (generation tokens/sec)

📏 How measured: reported by the original source; RigBase re-checked the numbers at that source

Model	Quant	Engine	tok/s
Qwen3.6 27B	llama-bench tg128 (quant per result)	llama.cpp	47.0
Gemma 4 31B	llama-bench tg128 (quant per result)	llama.cpp	43.8
Gemma 4 26B-A4B	llama-bench tg128 (quant per result)	llama.cpp	164
Gemma 4 12B	llama-bench tg128 (quant per result)	llama.cpp	98.1
gpt-oss 20B	llama-bench tg128 (quant per result)	llama.cpp	203
Qwen3.5 9B	llama-bench tg128 (quant per result)	llama.cpp	137
LFM2.5 24B-A2B	llama-bench tg128 (quant per result)	llama.cpp	261-339
Nemotron 3.5 Bolt 74B-A9B	llama-bench tg128 (quant per result)	llama.cpp	108

Community llama-bench results aggregated by llamabench.ai (decode tok/s, short context). Only runs without speculative decoding listed unless noted. Open the source for exact quant and llama.cpp version.

Current GPU street price (estimate, not the builder's cost)

1× RTX 4090: ≈€3,955 each (≈$4,433), new, approx. price as of 2026-10-16, lowest listing on billiger.de (ASUS TUF Gaming RTX 4090 OG OC 24 GB)

Estimated GPU cost for this build today: ≈€3,955
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.

Source: https://llamabench.ai/browse/rtx4090

Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.

Rent before you buy: try this model on a cloud GPU for a few dollars first: Runpod (referral link; sign up with Google to get the new-user bonus)

Quick answers: Can RTX 4090 run Gemma 4 12B? · Can RTX 4090 run Gemma 4 26B-A4B? · Can RTX 4090 run Gemma 4 31B? · Can RTX 4090 run LFM2.5 24B-A2B? · Can RTX 4090 run Nemotron 3.5 Bolt 74B-A9B? · Can RTX 4090 run Qwen3.5 9B? · Can RTX 4090 run Qwen3.6 27B? · Can RTX 4090 run gpt-oss 20B?