Small all-rounder that reads images too. Made by Alibaba.
Qwen 3.5 4B is a general chat model from Alibaba. Small all-rounder that reads images too. Running it locally needs about 4 GB of memory, and the download is 3.3 GB.
The least memory you need, by Apple chip:
Runs well on: RTX 3060 12GB, RTX 3070, RTX 3080 10GB, RTX 3090, RTX 4060, RTX 4060 Ti 16GB, RTX 4070 / 4070 Super, RTX 4070 Ti Super, RTX 4080 / 4080 Super, RTX 4090, RTX 5060, RTX 5060 Ti 16GB, RTX 5070, RTX 5070 Ti, RTX 5080, RTX 5090, Radeon RX 7800 XT, Radeon RX 9070 XT, Radeon RX 7900 XTX.
As an Amazon Associate I earn from qualifying purchases.
About 4 GB of video memory or unified memory (the download is 3.3 GB, plus room for the conversation). On a Mac, the smallest configuration that runs it is 8 GB.
A 16 GB M4 Mac runs it runs great at about 19 words a second. An 8 GB M1 Mac runs it runs well at about 11 words a second.
Yes, the model is free to download. Its licence is listed as Apache 2.0. That is a permissive licence that allows commercial use.
Install Ollama, then run: ollama run qwen3.5:4b
| Machine | Verdict | Speed |
|---|---|---|
| M1 8GB | Runs well | 11 words/s |
| M4 16GB | Runs great | 19 words/s |
| M4 32GB | Runs great | 19 words/s |
| M4 Pro 48GB | Runs great | 44 words/s |
| M4 Max 128GB | Runs great | 87 words/s |
| M3 Ultra 512GB | Runs great | 131 words/s |
| RTX 4060 | Runs great | 37 words/s |
| RTX 4070/4070 Super | Runs great | 69 words/s |
| RTX 5070 Ti | Runs great | 122 words/s |
| RTX 3090 | Runs great | 128 words/s |
| RTX 5090 | Runs great | 188 words/s |
| Ryzen AI Max+ 395 128GB | Runs great | 35 words/s |
| CPU only 32GB | Slow | 9 words/s |