Can I run moondream2 on an RTX 5080?
Yes
Its published weights (3.85 GB) fit in the 14.4 GB an RTX 5080 can use, with room for an unknown amount of context.
hf download vikhyatk/moondream2Files and context on RTX 5080
Each file of moondream2 (and of GGUF versions the site has analyzed), and how much context fits next to it, with the context cache in 16-bit or 8-bit.
| File | Size | On RTX 5080 | Context (16-bit) | Context (8-bit) |
|---|---|---|---|---|
| As published | 3.85 GB | Fits | not known | not known |
| 4-bit (estimate) | 1.08 GB | Fits | not known | not known |