Best small model for everyday questions and writing. Made by Google.
Gemma 4 E4B is a general chat model from Google. Best small model for everyday questions and writing. Running it locally needs about 7.4 GB of memory, and the download is 6.6 GB. It is a mixture of experts model: only about 1.8 GB of its weights are read for each word, so it generates much faster than a dense model of the same size, but all 6.6 GB still has to fit in memory.
The least memory you need, by Apple chip:
Runs well on: RTX 3060 12GB, RTX 3070, RTX 3080 10GB, RTX 3090, RTX 4060, RTX 4060 Ti 16GB, RTX 4070 / 4070 Super, RTX 4070 Ti Super, RTX 4080 / 4080 Super, RTX 4090, RTX 5060, RTX 5060 Ti 16GB, RTX 5070, RTX 5070 Ti, RTX 5080, RTX 5090, Radeon RX 7800 XT, Radeon RX 9070 XT, Radeon RX 7900 XTX.
As an Amazon Associate I earn from qualifying purchases.
About 7.4 GB of video memory or unified memory (the download is 6.6 GB, plus room for the conversation). On a Mac, the smallest configuration that runs it is 8 GB.
A 16 GB M4 Mac runs it runs great at about 20 words a second. An 8 GB M1 Mac runs it just fits at about 10 words a second.
Yes, the model is free to download. Its licence is listed as Open weights. Read the licence terms before using it in a business.
Install Ollama, then run: ollama run gemma4:e4b
| Machine | Verdict | Speed |
|---|---|---|
| M1 8GB | Just fits | 10 words/s |
| M4 16GB | Runs great | 20 words/s |
| M4 32GB | Runs great | 20 words/s |
| M4 Pro 48GB | Runs great | 45 words/s |
| M4 Max 128GB | Runs great | 89 words/s |
| M3 Ultra 512GB | Runs great | 134 words/s |
| RTX 4060 | Runs great | 38 words/s |
| RTX 4070/4070 Super | Runs great | 71 words/s |
| RTX 5070 Ti | Runs great | 126 words/s |
| RTX 3090 | Runs great | 132 words/s |
| RTX 5090 | Runs great | 188 words/s |
| Ryzen AI Max+ 395 128GB | Runs great | 36 words/s |
| CPU only 32GB | Slow | 9 words/s |