Builds / RTX 3090
RTX 3090 running Gemma 4 31B Q4_K_M (llama-bench)
Source: localllmadvisor.com ↗📏 How measured: reported by the original source; RigBase re-checked the numbers at that source
- GPU(s)
- RTX 3090
Amazon · eBay (used) · Newegg - VRAM / unified memory (GB)
- 24
- CPU
- not stated
- Motherboard
- not stated
- RAM
- not stated
- PSU
- not stated
- Other
- not stated
- Reported total cost
- not stated
- Power
- not stated
Measured speed (generation tokens/sec)
| Model | Quant | Engine | tok/s | Details |
|---|---|---|---|---|
| Gemma 4 31B | Q4_K_M | llama.cpp b11658 (llama-bench) | 38.8 | prefill 1,292 tok/s📏 llama-bench tg128 / pp512; 35.2 tok/s at 16K depth |
localllmadvisor llama-bench page. Rest of the system not stated.
Source: https://localllmadvisor.com/can-run/gemma-4-31b-on-rtx-3090-24gb.html
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: Runpod (referral link; sign up with Google to get the new-user bonus)
Quick answers: Can RTX 3090 run Gemma 4 31B?