Can I run Qwen3-14B on a Mac with 36 GB?
Yes, with a GGUF version
The published weights are too big, but the Q8_0 file from Qwen/Qwen3-14B-GGUF (15.7 GB) fits, with room for ≈ 40K tokens of context.
ollama run hf.co/Qwen/Qwen3-14B-GGUF:Q8_0Files and context on Mac with 36 GB
Each file of Qwen3-14B (and of GGUF versions the site has analyzed), and how much context fits next to it, with the context cache in 16-bit or 8-bit.
Qwen3-14B on other hardware
- NVIDIA H100Yes
- RTX 5090Yes, with a GGUF version
- RTX 4090Yes, with a GGUF version
- RTX 3090Yes, with a GGUF version
- RTX 5060 Ti 16 GBYes, with a GGUF version
- RTX 3060 12 GBYes, with a GGUF version
- RTX 4060No
- Mac with 32 GBYes, with a GGUF version
- Mac with 36 GBYes, with a GGUF version
- Mac with 64 GBYes
- Mac with 128 GBYes