Can I run DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF on a Mac with 256 GB?
Yes
Its IQ2_XXS file (138 GB) fits in the 192 GB a Mac with 256 GB can use, with room for an unknown amount of context. That file is under 3 bits per weight, so expect noticeably lower quality.
Full analysis of DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF
Everything that runs on Mac with 256 GB
Get the IQ2_XXS file on Hugging Face
llama-server -hf ISTA-DASLab/DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF:IQ2_XXSFiles and context on Mac with 256 GB
Each file of DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF (and of GGUF versions the site has analyzed), and how much context fits next to it, with the context cache in 16-bit or 8-bit.