Ternary-Bonsai-2-27B-gguf vs Qwen3.8-27B-GSQ-RCO-GGUF
Ternary-Bonsai-2-27B-gguf has 26.9B parameters (25.6B active per token) and takes 53.8 GB on disk; Qwen3.8-27B-GSQ-RCO-GGUF has 27.3B (25.6B active) and takes 10.4 GB. Compare them layer by layer.
At a glance
| prism-ml/Ternary-Bonsai-2-27B-gguf | ISTA-DASLab/Qwen3.8-27B-GSQ-RCO-GGUF | |
|---|---|---|
| Repo created | Sep 16, 2026updated Sep 17, 2026 | Aug 28, 2026updated Sep 2, 2026 |
| Model type | DenseHybrid attention: 48 linear + 16 full (GQA) | DenseHybrid attention: 48 linear + 17 full (GQA) |
| Inputs | Text + imagesvision encoder in a separate mmproj file, not counted here | Text + imagesvision encoder in a separate mmproj file, not counted here |
| Total parameters | 26.9B1.0× less | 27.3B1.0× more |
| Active per token | 25.6Bsame95% of the model | 25.6Bsame94% of the model |
| Experts | None (dense) | None (dense) |
| Max context (from config) | 256K tokenssame | 256K tokenssame |
| Layers | 64same48 linear + 16 full attention | 64same48 linear + 17 full attention · plus 1 extra prediction layer |
| On disk | 53.8 GB5.2× more1 file | 10.4 GB5.2× less1 file |
| Precision | FP16 (100%) | IQ3_S (22%), IQ3_XXS (20%), IQ2_S (19%), IQ4_XS (14%), Q2_K (6.0%), IQ2_XS (5.9%), IQ2_XXS (5.4%), Q4_K (3.7%), Q6_K (3.3%), other (1.3%) |
| Quantization | F16 (GGUF)original precision (FP16) | IQ3_XXS (GGUF)mix of IQ2_S, IQ3_XXS, IQ3_S +6 more · blocks of 256 · 100% of parameters |
| Fewest GPUs | 1× NVIDIA H100a single 80 GB card · weights only | 1× RTX 3060 12 GBa single 12 GB card · weights only |
| License | apache-2.0 | apache-2.0 |
| GitHub | Not linked | Not linked |
Where the parameters live
Each bar is one model, split by component and drawn on the same scale.
Anatomy map
Every rectangle is one component in one layer, with area proportional to its size. When you compare two models, both maps use the same scale, so a model twice the size covers twice the area.
Layer map
The model's layers from input (left) to output (right): which kind of attention each one uses, and whether its feed-forward block is a mixture of experts or a single dense network.
One token's route
In a mixture-of-experts layer, a router picks a few experts for each token. This shows how many that is, drawn to scale: the lit cells are one token's share of a single layer, and everything else sits idle in memory. Which cells light up is a random example, not the model's real router.
Can my GPU handle this model?
At a datacenter
The fewest GPUs of each type whose combined memory can hold the weights, assuming 90% of each GPU's memory is usable. Real deployments need more memory for context (KV cache), and usually round up to 8 or 16 GPUs so the model splits evenly. The list covers NVIDIA data-center GPUs widely rentable as of September 2026, best first.
At home
Whether the weights fit on popular home GPUs, assuming 90% of the card's memory is usable. People at home usually run 4-bit versions (GGUF files for llama.cpp, Ollama or LM Studio), which are much smaller than what labs publish, so both are shown. The 4-bit size is an estimate of about 4.5 bits per parameter. "Tight" means the weights fit but leave little room for context.
Context memory
Besides its weights, a model needs memory for the text it's working on (the "KV cache"), and it grows with every token of context. Figures are for one conversation stored in 16-bit precision: each simultaneous conversation needs its own, and servers that store it in 8-bit (FP8) need half as much.