RunsLocalGPU checkerLocal AI toolsv1.8 · data Oct 14, 2026

All models / Qwen3.8-Flash-Next

What GPU do I need to run Qwen3.8-Flash-Next?

Qwen3.8-Flash-Next has 176B parameters (6B active per token, mixture-of-experts). At Q4_K_M with 8K context it needs about 107.8 GB of memory. It needs a large unified-memory machine such as the M3 Ultra 256GB, or a multi-GPU setup. Because only 6B parameters are active, it still runs usably with offload to system RAM on cards like the RTX PRO 6000 Blackwell.

Check your own hardware

Memory by quantization (8K context)

QuantBits per weightMemory needed
Q8_08.5188.1 GB
Q6_K6.56145.4 GB
Q5_K_M5.69126.3 GB
Q4_K_M4.85107.8 GB
Q3_K_M3.9187.1 GB
IQ2_M2.760.5 GB

Hardware that runs it fully in fast memory

HardwareMemoryBest quantEst. speed
M3 Ultra 256GB256 GBQ6_K100 tok/s
M3 Ultra 512GB512 GBQ8_077 tok/s

Runs with offload to system RAM (slower)

Assumes 32 GB of DDR5 system RAM for offload. Estimates only; real speeds usually land within about 20%.