Can I run Qwythos-9B-Claude-Mythos-5-1M-GGUF on an RTX 5060 Ti 16 GB?
Yes
Its Q8_0 file (9.79 GB) fits in the 14.4 GB an RTX 5060 Ti 16 GB can use, with room for ≈ 136K tokens of context.
Full analysis of Qwythos-9B-Claude-Mythos-5-1M-GGUF
Everything that runs on RTX 5060 Ti 16 GB
Get the Q8_0 file on Hugging Face
ollama run hf.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF:Q8_0Files and context on RTX 5060 Ti 16 GB
Each file of Qwythos-9B-Claude-Mythos-5-1M-GGUF (and of GGUF versions the site has analyzed), and how much context fits next to it, with the context cache in 16-bit or 8-bit.
| File | Size | On RTX 5060 Ti 16 GB | Context (16-bit) | Context (8-bit) |
|---|---|---|---|---|
| Qwythos-9B-Claude-Mythos-5-1M-MTP-BF16 | 18.4 GB | Doesn't fit | — | — |
| BF16 | 17.9 GB | Doesn't fit | — | — |
| Q8_0 | 9.79 GB | Fits | 136K | 272K |
| Qwythos-9B-Claude-Mythos-5-1M-Q8_0 | 9.53 GB | Fits | 144K | 287K |
| Q6_K | 7.62 GB | Fits | 201K | 401K |
| Qwythos-9B-Claude-Mythos-5-1M-Q6_K | 7.36 GB | Fits | 208K | 417K |
| Q5_K_M | 6.73 GB | Fits | 227K | 454K |
| Qwythos-9B-Claude-Mythos-5-1M-Q5_K_M | 6.47 GB | Fits | 235K | 470K |
| Q4_K_M | 5.89 GB | Fits | 252K | 504K |
| Qwythos-9B-Claude-Mythos-5-1M-Q4_K_M | 5.63 GB | Fits | 260K | 520K |