Light code helper for autocomplete on smaller machines. Made by Alibaba.
Qwen2.5 Coder 7B is a coding model from Alibaba. Light code helper for autocomplete on smaller machines. Running it locally needs about 5.4 GB of memory, and the download is 4.7 GB.
The least memory you need, by Apple chip:
Runs well on: RTX 3060 12GB, RTX 3070, RTX 3080 10GB, RTX 3090, RTX 4060, RTX 4060 Ti 16GB, RTX 4070 / 4070 Super, RTX 4070 Ti Super, RTX 4080 / 4080 Super, RTX 4090, RTX 5060, RTX 5060 Ti 16GB, RTX 5070, RTX 5070 Ti, RTX 5080, RTX 5090, Radeon RX 7800 XT, Radeon RX 9070 XT, Radeon RX 7900 XTX.
As an Amazon Associate I earn from qualifying purchases.
About 5.4 GB of video memory or unified memory (the download is 4.7 GB, plus room for the conversation). On a Mac, the smallest configuration that runs it is 8 GB.
A 16 GB M4 Mac runs it runs great at about 14 words a second. An 8 GB M1 Mac runs it just fits at about 7 words a second.
Yes, the model is free to download. Its licence is listed as Apache 2.0. That is a permissive licence that allows commercial use.
Install Ollama, then run: ollama run qwen2.5-coder:7b
| Machine | Verdict | Speed |
|---|---|---|
| M1 8GB | Just fits | 7 words/s |
| M4 16GB | Runs great | 14 words/s |
| M4 32GB | Runs great | 14 words/s |
| M4 Pro 48GB | Runs great | 31 words/s |
| M4 Max 128GB | Runs great | 61 words/s |
| M3 Ultra 512GB | Runs great | 92 words/s |
| RTX 4060 | Runs great | 26 words/s |
| RTX 4070/4070 Super | Runs great | 48 words/s |
| RTX 5070 Ti | Runs great | 86 words/s |
| RTX 3090 | Runs great | 89 words/s |
| RTX 5090 | Runs great | 172 words/s |
| Ryzen AI Max+ 395 128GB | Runs great | 25 words/s |
| CPU only 32GB | Slow | 6 words/s |