Skip to content
DeepSeek

DeepSeek v3.2

Maker’s page
Check price at Amazon for DeepSeek DeepSeek-V3.2 (affiliate link, opens in new tab)
Weights at 16-bit
1,371 GB
Weights at 8-bit (Q8_0)
728 GB
Weights at 4-bit (Q4_K_M)
415 GB
Smallest card at 4-bit
More than one card
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
Experts
Experts per token
GGUF downloads
repobytesfilesquant
unsloth/DeepSeek-V3.2-GGUF161,280,830,5281 entriesUD-TQ1_0
unsloth/DeepSeek-V3.2-GGUF184,123,010,5604 entriesUD-IQ1_S
unsloth/DeepSeek-V3.2-GGUF199,310,536,3205 entriesUD-IQ1_M
unsloth/DeepSeek-V3.2-GGUF217,127,382,6885 entriesUD-IQ2_XXS
unsloth/DeepSeek-V3.2-GGUF228,110,708,3525 entriesUD-IQ2_M
unsloth/DeepSeek-V3.2-GGUF245,363,998,3365 entriesQ2_K
unsloth/DeepSeek-V3.2-GGUF245,581,188,7365 entriesQ2_K_L
unsloth/DeepSeek-V3.2-GGUF246,610,259,7126 entriesUD-Q2_K_XL
unsloth/DeepSeek-V3.2-GGUF273,130,614,5606 entriesUD-IQ3_XXS
unsloth/DeepSeek-V3.2-GGUF290,448,369,3446 entriesQ3_K_S
unsloth/DeepSeek-V3.2-GGUF320,231,581,5687 entriesQ3_K_M
unsloth/DeepSeek-V3.2-GGUF321,025,585,0567 entriesUD-Q3_K_XL
unsloth/DeepSeek-V3.2-GGUF358,347,337,6328 entriesIQ4_XS
unsloth/DeepSeek-V3.2-GGUF379,135,963,1048 entriesIQ4_NL
unsloth/DeepSeek-V3.2-GGUF380,088,791,0088 entriesQ4_0
unsloth/DeepSeek-V3.2-GGUF381,056,757,7288 entriesQ4_K_S
unsloth/DeepSeek-V3.2-GGUF405,398,024,3209 entriesQ4_K_M
unsloth/DeepSeek-V3.2-GGUF407,804,145,7609 entriesUD-Q4_K_XL
unsloth/DeepSeek-V3.2-GGUF420,771,131,5209 entriesQ4_1
unsloth/DeepSeek-V3.2-GGUF462,632,464,57610 entriesQ5_K_S
unsloth/DeepSeek-V3.2-GGUF476,161,405,15210 entriesQ5_K_M
unsloth/DeepSeek-V3.2-GGUF481,908,502,72010 entriesUD-Q5_K_XL
unsloth/DeepSeek-V3.2-GGUF551,313,406,52812 entriesQ6_K
unsloth/DeepSeek-V3.2-GGUF573,977,459,20012 entriesUD-Q6_K_XL
unsloth/DeepSeek-V3.2-GGUF713,286,531,61615 entriesQ8_0
unsloth/DeepSeek-V3.2-GGUF780,234,996,73617 entriesUD-Q8_K_XL
unsloth/DeepSeek-V3.2-GGUF1,342,273,065,37630 entriesBF16
Hidden size
KV heads
KV latent rank (MLA)
Layers
Licence
Parameters
Parameters by type
Publisher
RoPE key size (MLA)
Shared experts
Task

More from DeepSeek