Can I run Qwythos-9B-Claude-Mythos-5-1M-GGUF on an NVIDIA H100?

Yes

Its Qwythos-9B-Claude-Mythos-5-1M-MTP-BF16 file (18.4 GB) fits in the 72.0 GB an NVIDIA H100 can use, with room for ≈ 1M tokens of context.

Full analysis of Qwythos-9B-Claude-Mythos-5-1M-GGUF Everything that runs on NVIDIA H100 Get the Qwythos-9B-Claude-Mythos-5-1M-MTP-BF16 file on Hugging Face

ollama run hf.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF

Files and context on NVIDIA H100

Each file of Qwythos-9B-Claude-Mythos-5-1M-GGUF (and of GGUF versions the site has analyzed), and how much context fits next to it, with the context cache in 16-bit or 8-bit.

File	Size	On NVIDIA H100	Context (16-bit)	Context (8-bit)
Qwythos-9B-Claude-Mythos-5-1M-MTP-BF16	18.4 GB	Fits	1M	1M
BF16	17.9 GB	Fits	1M	1M
Q8_0	9.79 GB	Fits	1M	1M
Qwythos-9B-Claude-Mythos-5-1M-Q8_0	9.53 GB	Fits	1M	1M
Q6_K	7.62 GB	Fits	1M	1M
Qwythos-9B-Claude-Mythos-5-1M-Q6_K	7.36 GB	Fits	1M	1M
Q5_K_M	6.73 GB	Fits	1M	1M
Qwythos-9B-Claude-Mythos-5-1M-Q5_K_M	6.47 GB	Fits	1M	1M
Q4_K_M	5.89 GB	Fits	1M	1M
Qwythos-9B-Claude-Mythos-5-1M-Q4_K_M	5.63 GB	Fits	1M	1M

Qwythos-9B-Claude-Mythos-5-1M-GGUF on other hardware

Popular models that run on NVIDIA H100

Assumes 90% of the card's memory is usable and at least 4K tokens of context for one conversation, with the context cache in 16-bit unless noted. Fits leaves at least 20% of that memory for context; Tight leaves less.