Can I run Hemmingway-1-heretic-GGUF on an RTX 5090?
Yes
Its Q6_K file (22.4 GB) fits in the 28.8 GB an RTX 5090 can use, with room for ≈ 93K tokens of context.
Full analysis of Hemmingway-1-heretic-GGUF
Everything that runs on RTX 5090
Get the Q6_K file on Hugging Face
ollama run hf.co/Abiray/Hemmingway-1-heretic-GGUF:Q6_KFiles and context on RTX 5090
Each file of Hemmingway-1-heretic-GGUF (and of GGUF versions the site has analyzed), and how much context fits next to it, with the context cache in 16-bit or 8-bit.