Qwen
Qwen3 8B
Check price at Amazon for Qwen (Alibaba Cloud) Qwen3 8B (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 16 GB
- Weights at 8-bit (Q8_0)
- 8.7 GB
- Weights at 4-bit (Q4_K_M)
- 5.0 GB
- Smallest card at 4-bit
- Intel Arc A380 · 6 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- Family
- GGUF downloads
-
repo bytes files quant Qwen/Qwen3-8B-GGUF 5,027,783,488 1 entries Q4_K_M Qwen/Qwen3-8B-GGUF 5,720,761,152 1 entries Q5_0 Qwen/Qwen3-8B-GGUF 5,851,112,224 1 entries Q5_K_M Qwen/Qwen3-8B-GGUF 6,725,899,040 1 entries Q6_K Qwen/Qwen3-8B-GGUF 8,709,518,112 1 entries Q8_0 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Released
- Task