All models / GLM-5.3-Flash
GLM-5.3-Flash has 320B parameters (18B active per token, mixture-of-experts). At Q4_K_M with 8K context it needs about 196.0 GB of memory. It needs a large unified-memory machine such as the M3 Ultra 512GB, or a multi-GPU setup.
Check your own hardware| Quant | Bits per weight | Memory needed |
|---|---|---|
| Q8_0 | 8.5 | 342.0 GB |
| Q6_K | 6.56 | 264.4 GB |
| Q5_K_M | 5.69 | 229.6 GB |
| Q4_K_M | 4.85 | 196.0 GB |
| Q3_K_M | 3.91 | 158.4 GB |
| IQ2_M | 2.7 | 110.0 GB |
| Hardware | Memory | Best quant | Est. speed |
|---|---|---|---|
| M3 Ultra 512GB | 512 GB | Q8_0 | 26 tok/s |