Can I run humanizer on a Mac with 36 GB?
Yes, with a GGUF version
The published weights are too big, but the Q8_0 file from jialinyyzz/humanizer-GGUF (12.7 GB) fits, with room for ≈ 79K tokens of context.
ollama run hf.co/jialinyyzz/humanizer-GGUF:Q8_0Files and context on Mac with 36 GB
Each file of humanizer (and of GGUF versions the site has analyzed), and how much context fits next to it, with the context cache in 16-bit or 8-bit.
humanizer on other hardware
- NVIDIA H100Yes
- RTX 5090Yes, just
- RTX 4090Yes, with a GGUF version
- RTX 3090Yes, with a GGUF version
- RTX 5060 Ti 16 GBYes, with a GGUF version
- RTX 3060 12 GBYes, with a GGUF version
- RTX 4060Yes, with a GGUF version
- Mac with 32 GBYes, with a GGUF version
- Mac with 36 GBYes, with a GGUF version
- Mac with 64 GBYes
- Mac with 128 GBYes