Can I run DeepSeek-V4.1-Flash-1017-Uncensored-GSQ-RCO-Coder-GGUF on a Mac with 128 GB?
Yes
Its IQ2_XXS file (72.1 GB) fits in the 96.0 GB a Mac with 128 GB can use, with room for an unknown amount of context. That file is under 3 bits per weight, so expect noticeably lower quality.
Full analysis of DeepSeek-V4.1-Flash-1017-Uncensored-GSQ-RCO-Coder-GGUF
Everything that runs on Mac with 128 GB
Get the IQ2_XXS file on Hugging Face
llama-server -hf Abiray/DeepSeek-V4.1-Flash-1017-Uncensored-GSQ-RCO-Coder-GGUF:IQ2_XXSFiles and context on Mac with 128 GB
Each file of DeepSeek-V4.1-Flash-1017-Uncensored-GSQ-RCO-Coder-GGUF (and of GGUF versions the site has analyzed), and how much context fits next to it, with the context cache in 16-bit or 8-bit.