RunsLocalGPU checkerLocal AI toolsv1.8 · data Oct 14, 2026

All models / Gemma 4 E4B

What GPU do I need to run Gemma 4 E4B?

Gemma 4 E4B has 8B parameters (4.5B active per token, mixture-of-experts). At Q4_K_M with 8K context it needs about 5.6 GB of memory. The smallest graphics card that runs it fully on the GPU is about 8 GB, such as the RTX 4060.

Check your own hardware

Memory by quantization (8K context)

QuantBits per weightMemory needed
Q8_08.59.3 GB
Q6_K6.567.4 GB
Q5_K_M5.696.5 GB
Q4_K_M4.855.6 GB
Q3_K_M3.914.7 GB
IQ2_M2.73.5 GB

Hardware that runs it fully in fast memory

HardwareMemoryBest quantEst. speed
RTX 5060 Ti 8GB8 GBQ6_K73 tok/s
RTX 50608 GBQ6_K73 tok/s
RTX 30708 GBQ6_K73 tok/s
RTX 3060 Ti8 GBQ6_K73 tok/s
RTX 50508 GBQ6_K52 tok/s
RTX 4060 Ti 8GB8 GBQ6_K47 tok/s
RX 76008 GBQ6_K47 tok/s
RTX 40608 GBQ6_K44 tok/s
RTX 3080 10GB10 GBQ8_095 tok/s
RTX 2080 Ti11 GBQ8_077 tok/s
RTX 3080 Ti12 GBQ8_0114 tok/s
RTX 3080 12GB12 GBQ8_0114 tok/s
RTX 507012 GBQ8_084 tok/s
RTX 4070 Ti12 GBQ8_063 tok/s
RTX 4070 Super12 GBQ8_063 tok/s
RTX 407012 GBQ8_063 tok/s
Arc B58012 GBQ8_057 tok/s
RX 7700 XT12 GBQ8_054 tok/s
RTX 3060 12GB12 GBQ8_045 tok/s
RTX 508016 GBQ8_0120 tok/s
RTX 5070 Ti16 GBQ8_0112 tok/s
RTX 4080 Super16 GBQ8_092 tok/s
RTX 408016 GBQ8_090 tok/s
RTX 4070 Ti Super16 GBQ8_084 tok/s
RX 9070 XT16 GBQ8_080 tok/s
RX 907016 GBQ8_080 tok/s
RX 7800 XT16 GBQ8_078 tok/s
Arc A770 16GB16 GBQ8_070 tok/s
RX 6800 XT16 GBQ8_064 tok/s
RTX 5060 Ti 16GB16 GBQ8_056 tok/s
RX 9060 XT 16GB16 GBQ8_040 tok/s
RTX 4060 Ti 16GB16 GBQ8_036 tok/s
M5 16GB16 GBQ8_019 tok/s
M4 16GB16 GBQ8_015 tok/s
RX 7900 XT20 GBQ8_0100 tok/s
RTX 409024 GBQ8_0126 tok/s
RTX 3090 Ti24 GBQ8_0126 tok/s
RX 7900 XTX24 GBQ8_0120 tok/s
RTX 309024 GBQ8_0117 tok/s
M4 Pro 24GB24 GBQ8_034 tok/s
RTX 509032 GBQ8_0150+ tok/s
M5 32GB32 GBQ8_019 tok/s
M4 32GB32 GBQ8_015 tok/s
M4 Max 36GB36 GBQ8_051 tok/s
M4 Pro 48GB48 GBQ8_034 tok/s
M4 Max 64GB64 GBQ8_069 tok/s
Ryzen AI Max+ 395 64GB64 GBQ8_032 tok/s
RTX PRO 6000 Blackwell96 GBQ8_0150+ tok/s
M3 Ultra 96GB96 GBQ8_0103 tok/s
M4 Max 128GB128 GBQ8_069 tok/s
DGX Spark 128GB128 GBQ8_034 tok/s
Ryzen AI Max+ 395 128GB128 GBQ8_032 tok/s
M3 Ultra 256GB256 GBQ8_0103 tok/s
M3 Ultra 512GB512 GBQ8_0103 tok/s

Assumes 32 GB of DDR5 system RAM for offload. Estimates only; real speeds usually land within about 20%.