Can I run Gmcoder on a Radeon RX 9070 XT?
Probably, at 4-bit
The published weights are too big, but a 4-bit version (about 5.29 GB) would fit, with room for ≈ 256K tokens of context. The site hasn't analyzed a GGUF of Gmcoder yet.
Files and context on Radeon RX 9070 XT
Each file of Gmcoder (and of GGUF versions the site has analyzed), and how much context fits next to it, with the context cache in 16-bit or 8-bit.
| File | Size | On Radeon RX 9070 XT | Context (16-bit) | Context (8-bit) |
|---|---|---|---|---|
| As published | 18.8 GB | Doesn't fit | — | — |
| 4-bit (estimate) | 5.29 GB | Fits | 256K | 256K |