ZDTaichu5.0-9B vs jina-ocr-v1

Try Try

ZDTaichu5.0-9B has 9.79B parameters (8.13B active per token) and takes 19.6 GB on disk; jina-ocr-v1 has 3.37B (708M active) and takes 6.74 GB. Compare them layer by layer.

At a glance

TaichuAI/ZDTaichu5.0-9Bjinaai/jina-ocr-v1
Repo createdSep 4, 2026updated Sep 15, 2026Sep 1, 2026updated Sep 18, 2026
Model typeDenseHybrid attention: 24 linear + 8 full (GQA)Mixture of expertsFull attention (MHA)
InputsText + images652M vision encoderText + images303M vision encoder
Total parameters9.79B2.9× more3.37B2.9× less
Active per token8.13B11× more83% of the model708M11× less21% of the model
ExpertsNone (dense)6 of 64 activeplus 2 shared, always on
Max context (from config)256K tokens8.0× more32K tokens8.0× less
Layers322.7× more24 linear + 8 full attention122.7× less
On disk19.6 GB2.9× more5 files6.74 GB2.9× less2 files
PrecisionBF16 (100%)BF16 (100%)
QuantizationNoneoriginal precision (BF16)Noneoriginal precision (BF16)
Fewest GPUs1× RTX 4090a single 24 GB card · weights only1× RTX 4060a single 8 GB card · weights only
LicenseSee license filecc-by-nc-4.0
GitHubTaichu-AI/ZDTaichu5.0-9BNot linked