Skip to content
DeepSeek

DeepSeek R1 Distill Llama 70B

Maker’s page
Check price at Amazon for DeepSeek DeepSeek-R1-Distill-Llama-70B (affiliate link, opens in new tab)
Weights at 16-bit
141 GB
Weights at 8-bit (Q8_0)
75 GB
Weights at 4-bit (Q4_K_M)
43 GB
Smallest card at 4-bit
RTX 6000 Ada Generation · 48 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
Family
GGUF downloads
repobytesfilesquant
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF15,885,222,5601 entriesUD-IQ1_S
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF17,171,563,1681 entriesUD-IQ1_M
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF19,447,628,4481 entriesUD-IQ2_XXS
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF24,368,595,6161 entriesUD-IQ2_M
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF26,375,111,3281 entriesQ2_K
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF26,621,362,8481 entriesQ2_K_L
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF26,966,737,5681 entriesUD-Q2_K_XL
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF27,655,619,2321 entriesUD-IQ3_XXS
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF30,912,053,9201 entriesQ3_K_S
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF34,267,497,1201 entriesQ3_K_M
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF34,876,474,0161 entriesUD-Q3_K_XL
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF37,935,497,8881 entriesIQ4_XS
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF40,053,621,4081 entriesIQ4_NL
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF40,116,535,9681 entriesQ4_0
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF40,347,222,6881 entriesQ4_K_S
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF42,520,396,4481 entriesQ4_K_M
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF42,664,575,6481 entriesUD-Q4_K_XL
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF44,313,592,4801 entriesQ4_1
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF48,657,449,6321 entriesQ5_K_S
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF49,949,819,5521 entriesQ5_K_M
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF49,973,478,0481 entriesUD-Q5_K_XL
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF57,888,146,0802 entriesQ6_K
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF61,160,063,8722 entriesUD-Q6_K_XL
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF74,975,052,4162 entriesQ8_0
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF81,231,119,2002 entriesUD-Q8_K_XL
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF141,117,915,8723 entriesBF16
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF141,117,915,9363 entriesF16
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Released
Task

More DeepSeek-R1 Distill

Across the range 7 models by family