Near frontier quality at home, if you have 96 GB or more. Made by Alibaba.
Qwen 3.5 122B A10B is a general chat model from Alibaba. Near frontier quality at home, if you have 96 GB or more. Running it locally needs about 85.5 GB of memory, and the download is 81 GB. It is a mixture of experts model: only about 6.6 GB of its weights are read for each word, so it generates much faster than a dense model of the same size, but all 81 GB still has to fit in memory.
The least memory you need, by Apple chip:
No single desktop graphics card runs it well.
As an Amazon Associate I earn from qualifying purchases.
About 85.5 GB of video memory or unified memory (the download is 81 GB, plus room for the conversation). On a Mac, the smallest configuration that runs it is 96 GB.
A 16 GB M4 Mac cannot run it. An 8 GB M1 Mac cannot run it.
Yes, the model is free to download. Its licence is listed as Apache 2.0. That is a permissive licence that allows commercial use.
Install Ollama, then run: ollama run qwen3.5:122b
| Machine | Verdict | Speed |
|---|---|---|
| M1 8GB | Too big | |
| M4 16GB | Too big | |
| M4 32GB | Too big | |
| M4 Pro 48GB | Too big | |
| M4 Max 128GB | Runs great | 28 words/s |
| M3 Ultra 512GB | Runs great | 41 words/s |
| RTX 4060 | Too big | |
| RTX 4070/4070 Super | Too big | |
| RTX 5070 Ti | Too big | |
| RTX 3090 | Too big | |
| RTX 5090 | Too big | |
| Ryzen AI Max+ 395 128GB | Runs well | 11 words/s |
| CPU only 32GB | Too big |