Home / Models / gpt-oss 120B

What you need to run gpt-oss 120B

OpenAI's big open model. Fast for its size on high-memory machines. Made by OpenAI.

Memory needed~68.8 GB
Download65 GB
Smallest MacM2 Max 96GB
Smallest GPUNo single card
LicenceApache 2.0

About gpt-oss 120B

gpt-oss 120B is a general chat model from OpenAI. OpenAI's big open model. Fast for its size on high-memory machines. Running it locally needs about 68.8 GB of memory, and the download is 65 GB. It is a mixture of experts model: only about 3.3 GB of its weights are read for each word, so it generates much faster than a dense model of the same size, but all 65 GB still has to fit in memory.

Smallest Mac that runs it

The least memory you need, by Apple chip:

Graphics cards

No single desktop graphics card runs it well.

Hardware to run it

As an Amazon Associate I earn from qualifying purchases.

Lighter and heavier alternatives

Questions

How much memory does gpt-oss 120B need?

About 68.8 GB of video memory or unified memory (the download is 65 GB, plus room for the conversation). On a Mac, the smallest configuration that runs it is 96 GB.

Can I run gpt-oss 120B on a 16 GB Mac?

A 16 GB M4 Mac cannot run it. An 8 GB M1 Mac cannot run it.

Is gpt-oss 120B free to use?

Yes, the model is free to download. Its licence is listed as Apache 2.0. That is a permissive licence that allows commercial use.

How do I install gpt-oss 120B?

Install Ollama, then run: ollama run gpt-oss:120b

How it runs on popular machines

MachineVerdictSpeed
M1 8GBToo big
M4 16GBToo big
M4 32GBToo big
M4 Pro 48GBToo big
M4 Max 128GBRuns great53 words/s
M3 Ultra 512GBRuns great79 words/s
RTX 4060Too big
RTX 4070/4070 SuperToo big
RTX 5070 TiToo big
RTX 3090Too big
RTX 5090Slow9 words/s
Ryzen AI Max+ 395 128GBRuns great21 words/s
CPU only 32GBToo big

Check your exact machine