DeepSeek
DeepSeek R1 Distill Qwen 7B
Check price at Amazon for DeepSeek DeepSeek-R1-Distill-Qwen-7B (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 15 GB
- Weights at 8-bit (Q8_0)
- 8.1 GB
- Weights at 4-bit (Q4_K_M)
- 4.6 GB
- Smallest card at 4-bit
- Intel Arc A380 · 6 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- Family
- GGUF downloads
-
repo bytes files quant bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 2,780,342,240 1 entries IQ2_M bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 3,015,940,064 1 entries Q2_K bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 3,346,255,840 1 entries IQ3_XS bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 3,492,368,352 1 entries Q3_K_S bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 3,548,164,064 1 entries Q2_K_L bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 3,574,011,872 1 entries IQ3_M bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 3,808,391,136 1 entries Q3_K_M bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 4,088,459,232 1 entries Q3_K_L bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 4,218,472,416 1 entries IQ4_XS bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 4,437,813,216 1 entries IQ4_NL bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 4,444,121,056 1 entries Q4_0 bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 4,457,768,928 1 entries Q4_K_S bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 4,565,331,936 1 entries Q3_K_XL bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 4,683,073,504 1 entries Q4_K_M bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 4,873,283,552 1 entries Q4_1 bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 5,087,563,744 1 entries Q4_K_L bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 5,315,176,416 1 entries Q5_K_S bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 5,444,831,200 1 entries Q5_K_M bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 5,781,196,768 1 entries Q5_K_L bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 6,254,198,752 1 entries Q6_K bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 6,518,181,856 1 entries Q6_K_L bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 8,098,525,152 1 entries Q8_0 bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 15,237,853,152 1 entries F16 bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF 30,468,419,264 1 entries F32 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Released
- Task