Skip to content
DeepSeek

DeepSeek R1 Distill Qwen 14B

Maker’s page
Check price at Amazon for DeepSeek DeepSeek-R1-Distill-Qwen-14B (affiliate link, opens in new tab)
Weights at 16-bit
30 GB
Weights at 8-bit (Q8_0)
16 GB
Weights at 4-bit (Q4_K_M)
9.0 GB
Smallest card at 4-bit
Intel Arc B570 · 10 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
Family
GGUF downloads
repobytesfilesquant
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF4,704,574,8801 entriesIQ2_XS
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF5,003,726,2401 entriesIQ2_S
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF5,356,146,0801 entriesIQ2_M
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF5,770,497,4401 entriesQ2_K
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF6,383,361,4401 entriesIQ3_XS
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF6,530,817,4401 entriesQ2_K_L
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF6,659,595,6801 entriesQ3_K_S
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF6,916,537,7601 entriesIQ3_M
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF7,339,204,0001 entriesQ3_K_M
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF7,924,768,1601 entriesQ3_K_L
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF8,119,840,1601 entriesIQ4_XS
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF8,544,267,6801 entriesQ4_0
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF8,549,182,8801 entriesIQ4_NL
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF8,573,431,2001 entriesQ4_K_S
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF8,606,014,8801 entriesQ3_K_XL
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF8,988,110,2401 entriesQ4_K_M
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF9,392,139,6801 entriesQ4_1
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF9,565,953,4401 entriesQ4_K_L
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF10,266,553,7601 entriesQ5_K_S
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF10,508,873,1201 entriesQ5_K_M
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF10,989,395,3601 entriesQ5_K_L
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF12,124,683,6801 entriesQ6_K
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF12,501,802,4001 entriesQ6_K_L
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF15,701,597,6001 entriesQ8_0
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF29,547,716,0001 entriesF16
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF59,086,101,8242 entriesF32
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Released
Task

More DeepSeek-R1 Distill

Across the range 7 models by family