Qwen3-1.7B vs MiniCPM5-2B

Try Try

Qwen3-1.7B has 2.03B parameters (1.72B active per token) and takes 4.06 GB on disk; MiniCPM5-2B has 2.52B (2.25B active) and takes 5.03 GB. Compare them layer by layer.

At a glance

Qwen/Qwen3-1.7Bopenbmb/MiniCPM5-2B
Repo createdApr 27, 2025updated Jul 26, 2025Sep 6, 2026updated Sep 12, 2026
Model typeDenseFull attention (GQA)DenseFull attention (GQA)
InputsTextText
Total parameters2.03B1.2× less2.52B1.2× more
Active per token1.72B1.3× less85% of the model2.25B1.3× more89% of the model
ExpertsNone (dense)None (dense)
Max context (from config)40K tokens3.2× less128K tokens3.2× more
Layers281.5× less421.5× more
On disk4.06 GB1.2× less2 files5.03 GB1.2× more1 file
PrecisionBF16 (100%)BF16 (100%)
QuantizationNoneoriginal precision (BF16)Noneoriginal precision (BF16)
Fewest GPUs1× RTX 4060a single 8 GB card · weights only1× RTX 4060a single 8 GB card · weights only
Licenseapache-2.0apache-2.0
GitHubQwenLM/Qwen3OpenBMB/MiniCPM