Radeon AI Pro R9700 (one card): Qwen3.6 35B-A3B from 4K to 256K context (AMDai lab rig)

Name: Radeon AI Pro R9700 (one card): Qwen3.6 35B-A3B from 4K to 256K context (AMDai lab rig)
Creator: RigBase
License: https://creativecommons.org/licenses/by/4.0/

GPU(s)	AMD Radeon AI Pro R9700 (1 of 2 cards in the rig used) Amazon · eBay (used) · Newegg
VRAM / unified memory (GB)	32
CPU
Motherboard
RAM	256 GB DDR5 Amazon · eBay (used) · Newegg
PSU
Other	Second R9700 not used for these single-card runs
Reported total cost
Power

Measured speed (generation tokens/sec)

📏 How measured: reported by the original source; RigBase re-checked the numbers at that source

Model	Quant	Engine	tok/s
Qwen3.6 35B-A3B	Unsloth UD-Q5_K_XL, short context, f16 KV	llama.cpp Vulkan	102.39
Qwen3.6 35B-A3B	UD-Q5_K_XL, 32K context	llama.cpp Vulkan	90.52
Qwen3.6 35B-A3B	UD-Q5_K_XL, 128K context	llama.cpp Vulkan	66.43
Qwen3.6 35B-A3B	UD-Q5_K_XL, 256K context	llama.cpp Vulkan	44.4
Qwen3.6 35B-A3B	Q5_K_M (24.68 GB VRAM)	llama.cpp Vulkan	109.73
Qwen3.6 35B-A3B	Q4_K_M	llama.cpp Vulkan	117.69

AMDai lab notes, 'measured on our rig, 2026-10' (gfx1201, llama.cpp Vulkan, 0% system-RAM offload). The site lists the overnight sweep as pending re-verification after a DDR5 fix. Same rig: two single-card copies served about 100 tok/s per request.

Current GPU street price (estimate, not the builder's cost)

1× Radeon AI Pro R9700: ≈€1,718 each (≈$1,926), new, approx. price as of 2026-10-16, lowest listing on billiger.de (Asus Radeon AI PRO R9700 32 GB GDDR6)

Estimated GPU cost for this build today: ≈€1,718
New retail prices in Germany incl. VAT; used cards are often much cheaper. Prices change daily.

Source: https://amdai.net/

Blank fields = not stated in the source. We never estimate build data; GPU street prices above are separately sourced and dated.

Rent before you buy: try this model on a cloud GPU for a few dollars first: Runpod (referral link; sign up with Google to get the new-user bonus)

Quick answers: Can Radeon AI Pro R9700 run Qwen3.6 35B-A3B?