All hardware / Ryzen AI Max+ 395 64GB
With 64 GB unified memory, the Ryzen AI Max+ 395 64GB runs 16 of 22 popular open models fully in fast memory at Q4_K_M or better (8K context). The largest that fit are Llama 3.3 70B (Q4_K_M), Hermes 4.3 36B (Q8_0), Qwen3.6 35B-A3B (Q8_0). Fastest: Gemma 4 E2B at about 63 tokens/sec and Qwen3.6 35B-A3B at about 48 tokens/sec.
Check with your own RAM and context length| Model | Result | Best quant | Memory needed | Est. speed |
|---|---|---|---|---|
| Gemma 4 E2B | Runs on GPU | Q8_0 | 6.1 GB | 63 tok/s |
| Qwen3.6 35B-A3B | Runs on GPU | Q8_0 | 38.2 GB | 48 tok/s |
| gpt-oss-20b | Runs on GPU | Q8_0 | 23.2 GB | 40 tok/s |
| Ministral 3 3B | Runs on GPU | Q8_0 | 4.8 GB | 38 tok/s |
| Gemma 4 26B A4B | Runs on GPU | Q8_0 | 27.9 GB | 38 tok/s |
| Gemma 4 E4B | Runs on GPU | Q8_0 | 9.3 GB | 32 tok/s |
| Qwen3.5 9B | Runs on GPU | Q8_0 | 11.3 GB | 15 tok/s |
| Gemma 4 12B | Runs on GPU | Q8_0 | 13.8 GB | 12 tok/s |
| Phi-4 14B | Runs on GPU | Q8_0 | 17.7 GB | 9.8 tok/s |
| Mistral Small 3.1 24B | Runs on GPU | Q8_0 | 27.3 GB | 6.0 tok/s |
| Qwen3.6 27B | Runs on GPU | Q8_0 | 29.8 GB | 5.4 tok/s |
| Qwen3.8 27B | Runs on GPU | Q8_0 | 30.6 GB | 5.2 tok/s |
| Granite 4.2 30B | Runs on GPU | Q8_0 | 31.9 GB | 4.9 tok/s |
| Gemma 4 31B | Runs on GPU | Q8_0 | 33.8 GB | 4.7 tok/s |
| Hermes 4.3 36B | Runs on GPU | Q8_0 | 40.5 GB | 4.0 tok/s |
| Llama 3.3 70B | Runs on GPU | Q4_K_M | 45.9 GB | 3.6 tok/s |
| gpt-oss-120b | Lower quality fit | IQ2_M | 40.6 GB | 89 tok/s |
| Qwen3.5 122B-A10B | Lower quality fit | IQ2_M | 42.5 GB | 46 tok/s |
| Llama 4 Scout | Lower quality fit | IQ2_M | 38.8 GB | 27 tok/s |
| Qwen3.8-Flash-Next | Too big | Q4_K_M | 107.8 GB | — |
| GLM-5.3-Flash | Too big | Q4_K_M | 196.0 GB | — |
| DeepSeek V4.1-Flash | Too big | Q4_K_M | 335.8 GB | — |
OllamaLM StudioJanGPT4AllAnythingLLMllama.cppvLLMSGLangKoboldCppText Generation WebUILocalAI