Can I run xor on an NVIDIA H100?
Yes, just
Its published weights (70.2 GB) fit in the 72.0 GB an NVIDIA H100 can use, with room for ≈ 82K tokens of context.
hf download juspay/xorFiles and context on NVIDIA H100
Each file of xor (and of GGUF versions the site has analyzed), and how much context fits next to it, with the context cache in 16-bit or 8-bit.
| File | Size | On NVIDIA H100 | Context (16-bit) | Context (8-bit) |
|---|---|---|---|---|
| As published | 70.2 GB | Tight | 82K | 164K |
| 4-bit (estimate) | 19.7 GB | Fits | 256K | 256K |