Can I run Nanbeige4.3-33B-UNCENSORED-GGUF on a Mac with 24 GB?
Yes
Its IQ2_XXS file (9.33 GB) fits in the 16.0 GB a Mac with 24 GB can use, with room for ≈ 31K tokens of context. That file is under 3 bits per weight, so expect noticeably lower quality.
Full analysis of Nanbeige4.3-33B-UNCENSORED-GGUF
Everything that runs on Mac with 24 GB
Get the IQ2_XXS file on Hugging Face
ollama run hf.co/dealignai/Nanbeige4.3-33B-UNCENSORED-GGUF:IQ2_XXSFiles and context on Mac with 24 GB
Each file of Nanbeige4.3-33B-UNCENSORED-GGUF (and of GGUF versions the site has analyzed), and how much context fits next to it, with the context cache in 16-bit or 8-bit.