Skip to content
DeepSeek

DeepSeek R1 Distill Llama 8B

Maker’s page
Check price at Amazon for DeepSeek DeepSeek-R1-Distill-Llama-8B (affiliate link, opens in new tab)
Weights at 16-bit
16 GB
Weights at 8-bit (Q8_0)
8.5 GB
Weights at 4-bit (Q4_K_M)
4.9 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
Family
GGUF downloads
repobytesfilesquant
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF2,164,669,8881 entriesUD-IQ1_S
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF2,292,202,9441 entriesUD-IQ1_M
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF2,504,867,2641 entriesUD-IQ2_XXS
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF3,003,268,5441 entriesUD-IQ2_M
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF3,179,134,4001 entriesQ2_K
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF3,302,260,1601 entriesQ2_K_L
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF3,321,773,5041 entriesUD-IQ3_XXS
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF3,388,767,6801 entriesUD-Q2_K_XL
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF3,664,502,2081 entriesQ3_K_S
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF4,018,920,8961 entriesQ3_K_M
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF4,199,611,8401 entriesUD-Q3_K_XL
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF4,464,082,3681 entriesIQ4_XS
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF4,675,894,7201 entriesQ4_0
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF4,677,991,8721 entriesIQ4_NL
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF4,692,671,9361 entriesQ4_K_S
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF4,920,737,2161 entriesQ4_K_M
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF4,994,203,0721 entriesUD-Q4_K_XL
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF5,130,255,8081 entriesQ4_1
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF5,599,296,9601 entriesQ5_K_S
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF5,732,990,4001 entriesQ5_K_M
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF5,738,134,9761 entriesUD-Q5_K_XL
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF6,596,009,4081 entriesQ6_K
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF7,329,930,6881 entriesUD-Q6_K_XL
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF8,540,773,0881 entriesQ8_0
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF10,575,666,6241 entriesUD-Q8_K_XL
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF16,068,893,4081 entriesF16
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF16,068,893,8561 entriesBF16
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Released
Task

More DeepSeek-R1 Distill

Across the range 7 models by family