All models / Muse Spark Open 816B-A42B
Muse Spark Open 816B-A42B has 816B parameters (42B active per token, mixture-of-experts). At Q4_K_M with 8K context it needs about 497.3 GB of memory. It is too large for any single consumer card or Mac in our list at Q4; it needs a multi-GPU server.
Check your own hardware| Quant | Bits per weight | Memory needed |
|---|---|---|
| Q8_0 | 8.5 | 869.6 GB |
| Q6_K | 6.56 | 671.7 GB |
| Q5_K_M | 5.69 | 583.0 GB |
| Q4_K_M | 4.85 | 497.3 GB |
| Q3_K_M | 3.91 | 401.4 GB |
| IQ2_M | 2.7 | 278.0 GB |