OTel-2.0-LLM-31B-IT vs GLM-5.3-Flash

Try Try

OTel-2.0-LLM-31B-IT has 31.3B parameters (30.7B active per token) and takes 62.5 GB on disk; GLM-5.3-Flash has 321B (16.7B active) and takes 328 GB. Compare them layer by layer.

At a glance

farbodtavakkoli/OTel-2.0-LLM-31B-ITzai-org/GLM-5.3-Flash
Repo createdJul 23, 2026updated Sep 8, 2026Aug 25, 2026updated Sep 7, 2026
Model typeDenseFull attention (GQA)Mixture of expertsHybrid attention: 34 linear + 12 full (MLA)
InputsText + images576M vision encoderText + images564M vision encoder
Total parameters31.3B10× less321B10× more
Active per token30.7B1.8× more98% of the model16.7B1.8× less5.2% of the model
ExpertsNone (dense)8 of 288 activeplus 1 shared, always on
Max context (from config)256K tokens4.0× less1M tokens4.0× more
Layers601.3× more451.3× less34 linear + 12 full attention · plus 1 extra prediction layer
On disk62.5 GB5.2× less15 files328 GB5.2× more62 files
PrecisionBF16 (100%)FP8 E4M3 (96%), BF16 (4.2%)
QuantizationNoneoriginal precision (BF16)FP8 E4M3blocks of 128×128 · 98% of parameters · attention, embeddings & output head and vision encoder kept in BF16
Fewest GPUs1× NVIDIA H100a single 80 GB card · weights only5× NVIDIA H100fits in one 8-GPU server · weights only
Licenseapache-2.0mit
GitHubfarbodtavakkoli/OTelNot linked