Older but solid large model. Needs serious memory. Made by Meta.
Llama 3.3 70B is a general chat model from Meta. Older but solid large model. Needs serious memory. Running it locally needs about 45.6 GB of memory, and the download is 43 GB.
The least memory you need, by Apple chip:
No single desktop graphics card runs it well. Runs slowly with help from system RAM on: RTX 5090.
As an Amazon Associate I earn from qualifying purchases.
About 45.6 GB of video memory or unified memory (the download is 43 GB, plus room for the conversation). On a Mac, the smallest configuration that runs it is 64 GB.
A 16 GB M4 Mac cannot run it. An 8 GB M1 Mac cannot run it.
Yes, the model is free to download. Its licence is listed as Llama licence. Read the licence terms before using it in a business.
Install Ollama, then run: ollama run llama3.3:70b
| Machine | Verdict | Speed |
|---|---|---|
| M1 8GB | Too big | |
| M4 16GB | Too big | |
| M4 32GB | Too big | |
| M4 Pro 48GB | Too big | |
| M4 Max 128GB | Runs well | 7 words/s |
| M3 Ultra 512GB | Runs well | 10 words/s |
| RTX 4060 | Too big | |
| RTX 4070/4070 Super | Too big | |
| RTX 5070 Ti | Too big | |
| RTX 3090 | Too big | |
| RTX 5090 | Very slow | 2 words/s |
| Ryzen AI Max+ 395 128GB | Slow | 3 words/s |
| CPU only 32GB | Too big |