Qwen
Qwen3 4B Thinking 2507
Check price at Amazon for Qwen (Alibaba Cloud) Qwen3-4B-Thinking-2507 (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 8.0 GB
- Weights at 8-bit (Q8_0)
- 4.3 GB
- Weights at 4-bit (Q4_K_M)
- 2.4 GB
- Smallest card at 4-bit
- Intel Arc A380 · 6 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- GGUF downloads
-
repo bytes files quant unsloth/Qwen3-4B-Thinking-2507-GGUF 1,083,149,952 1 entries UD-IQ1_S unsloth/Qwen3-4B-Thinking-2507-GGUF 1,143,484,032 1 entries UD-IQ1_M unsloth/Qwen3-4B-Thinking-2507-GGUF 1,255,345,792 1 entries UD-IQ2_XXS unsloth/Qwen3-4B-Thinking-2507-GGUF 1,530,402,432 1 entries UD-IQ2_M unsloth/Qwen3-4B-Thinking-2507-GGUF 1,669,500,032 1 entries Q2_K unsloth/Qwen3-4B-Thinking-2507-GGUF 1,669,500,032 1 entries Q2_K_L unsloth/Qwen3-4B-Thinking-2507-GGUF 1,674,376,832 1 entries UD-IQ3_XXS unsloth/Qwen3-4B-Thinking-2507-GGUF 1,695,724,672 1 entries UD-Q2_K_XL unsloth/Qwen3-4B-Thinking-2507-GGUF 1,886,997,632 1 entries Q3_K_S unsloth/Qwen3-4B-Thinking-2507-GGUF 2,075,618,432 1 entries Q3_K_M unsloth/Qwen3-4B-Thinking-2507-GGUF 2,128,385,152 1 entries UD-Q3_K_XL unsloth/Qwen3-4B-Thinking-2507-GGUF 2,270,751,872 1 entries IQ4_XS unsloth/Qwen3-4B-Thinking-2507-GGUF 2,375,773,312 1 entries Q4_0 unsloth/Qwen3-4B-Thinking-2507-GGUF 2,381,343,872 1 entries IQ4_NL unsloth/Qwen3-4B-Thinking-2507-GGUF 2,383,309,952 1 entries Q4_K_S unsloth/Qwen3-4B-Thinking-2507-GGUF 2,497,281,152 1 entries Q4_K_M unsloth/Qwen3-4B-Thinking-2507-GGUF 2,546,340,992 1 entries UD-Q4_K_XL unsloth/Qwen3-4B-Thinking-2507-GGUF 2,596,629,632 1 entries Q4_1 unsloth/Qwen3-4B-Thinking-2507-GGUF 2,823,711,872 1 entries Q5_K_S unsloth/Qwen3-4B-Thinking-2507-GGUF 2,889,514,112 1 entries Q5_K_M unsloth/Qwen3-4B-Thinking-2507-GGUF 2,899,221,632 1 entries UD-Q5_K_XL unsloth/Qwen3-4B-Thinking-2507-GGUF 3,306,261,632 1 entries Q6_K unsloth/Qwen3-4B-Thinking-2507-GGUF 3,658,223,232 1 entries UD-Q6_K_XL unsloth/Qwen3-4B-Thinking-2507-GGUF 4,280,405,632 1 entries Q8_0 unsloth/Qwen3-4B-Thinking-2507-GGUF 5,056,700,032 1 entries UD-Q8_K_XL unsloth/Qwen3-4B-Thinking-2507-GGUF 8,051,285,344 1 entries F16 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Task
More from Qwen (Alibaba Cloud)
- Qwen (Alibaba Cloud) Qwen-7B
- Qwen (Alibaba Cloud) Qwen-7B-Chat
- Qwen (Alibaba Cloud) Qwen1.5-0.5B
- Qwen (Alibaba Cloud) Qwen1.5-0.5B-Chat
- Qwen (Alibaba Cloud) Qwen1.5-1.8B-Chat
- Qwen (Alibaba Cloud) Qwen1.5-7B
- Qwen (Alibaba Cloud) Qwen1.5-32B-Chat
- Qwen (Alibaba Cloud) Qwen1.5-MoE-A2.7B
- Qwen (Alibaba Cloud) Qwen1.5-MoE-A2.7B-Chat
- Qwen (Alibaba Cloud) Qwen2-0.5B
- Qwen (Alibaba Cloud) Qwen2-0.5B-Instruct
- Qwen (Alibaba Cloud) Qwen2-1.5B