DeepSeek
DeepSeek R1 Distill Llama 8B
Check price at Amazon for DeepSeek DeepSeek-R1-Distill-Llama-8B (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 16 GB
- Weights at 8-bit (Q8_0)
- 8.5 GB
- Weights at 4-bit (Q4_K_M)
- 4.9 GB
- Smallest card at 4-bit
- Intel Arc A380 · 6 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- Family
- GGUF downloads
-
repo bytes files quant unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 2,164,669,888 1 entries UD-IQ1_S unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 2,292,202,944 1 entries UD-IQ1_M unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 2,504,867,264 1 entries UD-IQ2_XXS unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 3,003,268,544 1 entries UD-IQ2_M unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 3,179,134,400 1 entries Q2_K unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 3,302,260,160 1 entries Q2_K_L unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 3,321,773,504 1 entries UD-IQ3_XXS unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 3,388,767,680 1 entries UD-Q2_K_XL unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 3,664,502,208 1 entries Q3_K_S unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 4,018,920,896 1 entries Q3_K_M unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 4,199,611,840 1 entries UD-Q3_K_XL unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 4,464,082,368 1 entries IQ4_XS unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 4,675,894,720 1 entries Q4_0 unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 4,677,991,872 1 entries IQ4_NL unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 4,692,671,936 1 entries Q4_K_S unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 4,920,737,216 1 entries Q4_K_M unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 4,994,203,072 1 entries UD-Q4_K_XL unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 5,130,255,808 1 entries Q4_1 unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 5,599,296,960 1 entries Q5_K_S unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 5,732,990,400 1 entries Q5_K_M unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 5,738,134,976 1 entries UD-Q5_K_XL unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 6,596,009,408 1 entries Q6_K unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 7,329,930,688 1 entries UD-Q6_K_XL unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 8,540,773,088 1 entries Q8_0 unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 10,575,666,624 1 entries UD-Q8_K_XL unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 16,068,893,408 1 entries F16 unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 16,068,893,856 1 entries BF16 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Released
- Task