Can I run Qwen3.8-27B-Jumbo-Fusion-IQ-747-900-Turbo-Brilliance-50X-Reasoning-Instruct-NEO-MAX-MTP-GGUF on an RTX 4090?
Yes, just
Its Q5_K_M file (19.5 GB) fits in the 21.6 GB an RTX 4090 can use, with room for ≈ 28K tokens of context.
Full analysis of Qwen3.8-27B-Jumbo-Fusion-IQ-747-900-Turbo-Brilliance-50X-Reasoning-Instruct-NEO-MAX-MTP-GGUF
Everything that runs on RTX 4090
Get the Q5_K_M file on Hugging Face
ollama run hf.co/DavidAU/Qwen3.8-27B-Jumbo-Fusion-IQ-747-900-Turbo-Brilliance-50X-Reasoning-Instruct-NEO-MAX-MTP-GGUF:Q5_K_MFiles and context on RTX 4090
Each file of Qwen3.8-27B-Jumbo-Fusion-IQ-747-900-Turbo-Brilliance-50X-Reasoning-Instruct-NEO-MAX-MTP-GGUF (and of GGUF versions the site has analyzed), and how much context fits next to it, with the context cache in 16-bit or 8-bit.