Can I run Qwen3.8-35B-A3B-Distill-MTP-APEX-I-MiniPlus-V2.1-Abliterated-GGUF on an NVIDIA B300?
Yes
Its Qwen3.8-35B-A3B-Distill.APEX-I-MiniPlus-V2.1-Abliterated file (14.7 GB) fits in the 259 GB an NVIDIA B300 can use, with room for ≈ 256K tokens of context.
Full analysis of Qwen3.8-35B-A3B-Distill-MTP-APEX-I-MiniPlus-V2.1-Abliterated-GGUF
Everything that runs on NVIDIA B300
Get the Qwen3.8-35B-A3B-Distill.APEX-I-MiniPlus-V2.1-Abliterated file on Hugging Face
ollama run hf.co/IsValorum/Qwen3.8-35B-A3B-Distill-MTP-APEX-I-MiniPlus-V2.1-Abliterated-GGUFFiles and context on NVIDIA B300
Each file of Qwen3.8-35B-A3B-Distill-MTP-APEX-I-MiniPlus-V2.1-Abliterated-GGUF (and of GGUF versions the site has analyzed), and how much context fits next to it, with the context cache in 16-bit or 8-bit.
| File | Size | On NVIDIA B300 | Context (16-bit) | Context (8-bit) |
|---|---|---|---|---|
| Qwen3.8-35B-A3B-Distill.APEX-I-MiniPlus-V2.1-Abliterated | 14.7 GB | Fits | 256K | 256K |