Frontier class. Needs a 512 GB Mac Studio or a server. Made by DeepSeek.
DeepSeek V3 671B is a general chat model from DeepSeek. Frontier class. Needs a 512 GB Mac Studio or a server. Running it locally needs about 424.7 GB of memory, and the download is 404 GB. It is a mixture of experts model: only about 22 GB of its weights are read for each word, so it generates much faster than a dense model of the same size, but all 404 GB still has to fit in memory.
The least memory you need, by Apple chip:
No single desktop graphics card runs it well.
As an Amazon Associate I earn from qualifying purchases.
About 424.7 GB of video memory or unified memory (the download is 404 GB, plus room for the conversation). On a Mac, the smallest configuration that runs it is 512 GB.
A 16 GB M4 Mac cannot run it. An 8 GB M1 Mac cannot run it.
Yes, the model is free to download. Its licence is listed as DeepSeek licence. Read the licence terms before using it in a business.
Install Ollama, then run: ollama run deepseek-v3
| Machine | Verdict | Speed |
|---|---|---|
| M1 8GB | Too big | |
| M4 16GB | Too big | |
| M4 32GB | Too big | |
| M4 Pro 48GB | Too big | |
| M4 Max 128GB | Too big | |
| M3 Ultra 512GB | Just fits | 11 words/s |
| RTX 4060 | Too big | |
| RTX 4070/4070 Super | Too big | |
| RTX 5070 Ti | Too big | |
| RTX 3090 | Too big | |
| RTX 5090 | Too big | |
| Ryzen AI Max+ 395 128GB | Too big | |
| CPU only 32GB | Too big |