Can I run Edge0-8B-A1B-preview on an RTX 4080?
Yes
Its published weights (4.56 GB) fit in the 14.4 GB an RTX 4080 can use, with room for an unknown amount of context.
Full analysis of Edge0-8B-A1B-preview
Everything that runs on RTX 4080
Get the weights on Hugging Face
hf download Edge0/Edge0-8B-A1B-previewFiles and context on RTX 4080
Each file of Edge0-8B-A1B-preview (and of GGUF versions the site has analyzed), and how much context fits next to it, with the context cache in 16-bit or 8-bit.
| File | Size | On RTX 4080 | Context (16-bit) | Context (8-bit) |
|---|---|---|---|---|
| As published | 4.56 GB | Fits | not known | not known |