Can I run xor on a Radeon RX 7900 XTX?
Probably, at 4-bit
The published weights are too big, but a 4-bit version (about 19.7 GB) would fit, with room for ≈ 85K tokens of context. The site hasn't analyzed a GGUF of xor yet.
Files and context on Radeon RX 7900 XTX
Each file of xor (and of GGUF versions the site has analyzed), and how much context fits next to it, with the context cache in 16-bit or 8-bit.
| File | Size | On Radeon RX 7900 XTX | Context (16-bit) | Context (8-bit) |
|---|---|---|---|---|
| As published | 70.2 GB | Doesn't fit | — | — |
| 4-bit (estimate) | 19.7 GB | Tight | 85K | 170K |