Can I run Supra2.5-Pro-Instruct on an RTX 4060?
Yes
Its published weights (268 MB) fit in the 7.20 GB an RTX 4060 can use, with room for ≈ 512 tokens of context.
Full analysis of Supra2.5-Pro-Instruct
Everything that runs on RTX 4060
Get the weights on Hugging Face
hf download SupraLabs/Supra2.5-Pro-InstructFiles and context on RTX 4060
Each file of Supra2.5-Pro-Instruct (and of GGUF versions the site has analyzed), and how much context fits next to it, with the context cache in 16-bit or 8-bit.
| File | Size | On RTX 4060 | Context (16-bit) | Context (8-bit) |
|---|---|---|---|---|
| As published | 268 MB | Fits | 512 | 512 |
| 4-bit (estimate) | 37.7 MB | Fits | 512 | 512 |