OpenAI's big open model. Fast for its size on high-memory machines. Made by OpenAI.
gpt-oss 120B is a general chat model from OpenAI. OpenAI's big open model. Fast for its size on high-memory machines. Running it locally needs about 68.8 GB of memory, and the download is 65 GB. It is a mixture of experts model: only about 3.3 GB of its weights are read for each word, so it generates much faster than a dense model of the same size, but all 65 GB still has to fit in memory.
The least memory you need, by Apple chip:
No single desktop graphics card runs it well.
As an Amazon Associate I earn from qualifying purchases.
About 68.8 GB of video memory or unified memory (the download is 65 GB, plus room for the conversation). On a Mac, the smallest configuration that runs it is 96 GB.
A 16 GB M4 Mac cannot run it. An 8 GB M1 Mac cannot run it.
Yes, the model is free to download. Its licence is listed as Apache 2.0. That is a permissive licence that allows commercial use.
Install Ollama, then run: ollama run gpt-oss:120b
| Machine | Verdict | Speed |
|---|---|---|
| M1 8GB | Too big | |
| M4 16GB | Too big | |
| M4 32GB | Too big | |
| M4 Pro 48GB | Too big | |
| M4 Max 128GB | Runs great | 53 words/s |
| M3 Ultra 512GB | Runs great | 79 words/s |
| RTX 4060 | Too big | |
| RTX 4070/4070 Super | Too big | |
| RTX 5070 Ti | Too big | |
| RTX 3090 | Too big | |
| RTX 5090 | Slow | 9 words/s |
| Ryzen AI Max+ 395 128GB | Runs great | 21 words/s |
| CPU only 32GB | Too big |