RTX 3090 (llm-speed signed run, Oct 2026): Flint 40B-A2.5B Q3_K_XL at 128.9 tok/s
| GPU(s) | RTX 3090 Amazon · eBay (used) · Newegg |
|---|---|
| VRAM / unified memory (GB) | 24 |
| CPU | AMD EPYC 7763 (64 cores) Amazon · eBay (used) · Newegg |
| Motherboard | |
| RAM | 1008 GB Amazon · eBay (used) · Newegg |
| PSU | |
| Other | Server host; llm-speed suite-v1 chat-short workload |
| Reported total cost | |
| Power |
Measured speed (generation tokens/sec)
📏 How measured: reported by the original source; RigBase re-checked the numbers at that source
| Model | Quant | Engine | tok/s | Details |
|---|---|---|---|---|
| Flint 40B-A2.5B | UD-Q3_K_XL | llama.cpp 0.7.0-dev (build 11803) | 128.9 |
Signed community run on llm-speed.com, 22 Oct 2026, 16K context. chat-long (4K prompt) decode: 123.0 tok/s. An 8K-context run on the same host: 130.8 tok/s (https://llm-speed.com/r/r_-yeg4qnhjp7).
Source: https://llm-speed.com/r/r_v-sdiljpm7i
Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.
Rent before you buy: try this model on a cloud GPU for a few dollars first: Runpod (referral link; sign up with Google to get the new-user bonus)
Quick answers: Can RTX 3090 run Flint 40B-A2.5B?