Can I run Qwen3-30B-A3B on an RTX 5090?
Yes, with a GGUF version
The published weights are too big, but the Q6_K file from Qwen/Qwen3-30B-A3B-GGUF (25.1 GB) fits, with room for ≈ 37K tokens of context.
ollama run hf.co/Qwen/Qwen3-30B-A3B-GGUF:Q6_KFiles and context on RTX 5090
Each file of Qwen3-30B-A3B (and of GGUF versions the site has analyzed), and how much context fits next to it, with the context cache in 16-bit or 8-bit.