The largest open-weight AI models, by parameter count
The biggest open-weight models now rival closed ones in size: some have over a trillion parameters. The table ranks every original model the site has analyzed by total parameters (GGUF re-uploads of the same models are left out).
| Model | Params | On disk | Context |
|---|---|---|---|
| moonshotai/Kimi-K3.1-Pro | 2.78T | 1.56 TB | 1M |
| moonshotai/Kimi-K3 | 2.78T | 1.56 TB | 1M |
| Qwen/Qwen3.8-2.4T-A95B-FP8 | 2.45T | 2.50 TB | 256K |
| Qwen/Qwen3.8-2.4T-A95B | 2.45T | 4.89 TB | 256K |
| meituan-longcat/LongCat-2.5 | 1.78T | 3.56 TB | 512K |
| mistralai/Mistral-Large-4-1T-A52B | 1.05T | 1.06 TB | 1M |
| moonshotai/Kimi-K2.7-Code | 1.03T | 595 GB | 256K |
| moonshotai/Kimi-K2.6 | 1.03T | 595 GB | 256K |
| moonshotai/Kimi-K2.5 | 1.03T | 595 GB | 256K |
| moonshotai/Kimi-K2-Instruct-0905 | 1.03T | 1.03 TB | 256K |
| moonshotai/Kimi-K2-Thinking | 1.03T | 594 GB | 256K |
| moonshotai/Kimi-K2-Base | 1.03T | 1.03 TB | 128K |
| moonshotai/Kimi-K2-Instruct | 1.03T | 1.03 TB | 128K |
| thinkingmachines/Inkling | 952B | 1.90 TB | — |
| tencent/Hy4-preview | 780B | 1.56 TB | 1M |
| zai-org/GLM-5 | 754B | 1.51 TB | 198K |
| zai-org/GLM-5.1 | 754B | 1.51 TB | 198K |
| JANGQ-AI/GLM-5.3-FP8 | 753B | 756 GB | 1M |
| zai-org/GLM-5.2 | 753B | 1.51 TB | 1M |
| Blackfrost-Research/GLM-5.3-F.U-AnthraClaud-Edition-BF16 | 753B | 1.51 TB | 1M |
Total parameters aren't the whole story
Most of the largest models are mixture-of-experts (MoE): each layer holds many small "experts", and a router picks a few of them for every token. So two numbers matter:
- Total parameters decide how much memory the model needs: every expert has to be loaded.
- Active parameters decide how much work each token takes, which is why a huge MoE model can generate text as fast as a much smaller dense one.
"On disk" is the size of the published weights. Many labs now publish in 8-bit (FP8) or 4-bit (MXFP4) formats, which is why some models with more parameters take less space than smaller ones.
Large but light
These mixture-of-experts models use at most 10 billion parameters per token: fast to run, if you have the memory to hold them.
| Model | Params | Active | Share active |
|---|---|---|---|
| inclusionAI/Ling-3.0-flash-Sante | 127B | 5.10B | 4% |
| Qwen/Qwen3.5-122B-A10B-FP8 | 125B | 9.19B | 7% |
| ornith-ai/Ornith-1.5-122B | 125B | 9.19B | 7% |
| Qwen/Qwen3.5-122B-A10B-GPTQ-Int4 | 125B | 9.19B | 7% |
| Qwen/Qwen3.5-122B-A10B | 125B | 9.19B | 7% |
| poolside/Laguna-S-2.1 | 118B | 8.14B | 7% |
| openai/gpt-oss-120b | 117B | 5.13B | 4% |
| Qwen/Qwen3-Next-80B-A3B-Instruct-FP8 | 81.3B | 3.64B | 4% |
| Qwen/Qwen3-Next-80B-A3B-Thinking-FP8 | 81.3B | 3.64B | 4% |
| Qwen/Qwen3-Next-80B-A3B-Thinking | 81.3B | 3.64B | 4% |
| Qwen/Qwen3-Next-80B-A3B-Instruct | 81.3B | 3.64B | 4% |
| yandex/AliceAI-Foundation-80B-A3B-Base | 81.3B | 3.64B | 4% |
| Qwen/Qwen3-Coder-Next-FP8 | 79.7B | 3.56B | 4% |
| Qwen/Qwen3-Coder-Next-Base | 79.7B | 3.56B | 4% |
| Qwen/Qwen3-Coder-Next | 79.7B | 3.56B | 4% |
What does it take to run them?
Each model's page has a Hardware tab with the data-center GPUs needed to hold it, and the hardware calculator shows which ones fit on a given GPU or Mac.