Qwen
Qwen2.5 Coder 3B Instruct
Check price at Amazon for Qwen (Alibaba Cloud) Qwen2.5-Coder-3B-Instruct (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 6.2 GB
- Weights at 8-bit (Q8_0)
- 3.3 GB
- Weights at 4-bit (Q4_K_M)
- 1.9 GB
- Smallest card at 4-bit
- Intel Arc A380 · 6 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- GGUF downloads
-
repo bytes files quant Qwen/Qwen2.5-Coder-3B-Instruct-GGUF 1,376,856,512 1 entries Q2_K Qwen/Qwen2.5-Coder-3B-Instruct-GGUF 1,724,178,880 1 entries Q3_K_M Qwen/Qwen2.5-Coder-3B-Instruct-GGUF 1,997,879,744 1 entries Q4_0 Qwen/Qwen2.5-Coder-3B-Instruct-GGUF 2,104,932,800 1 entries Q4_K_M Qwen/Qwen2.5-Coder-3B-Instruct-GGUF 2,383,591,872 1 entries Q5_0 Qwen/Qwen2.5-Coder-3B-Instruct-GGUF 2,438,740,416 1 entries Q5_K_M Qwen/Qwen2.5-Coder-3B-Instruct-GGUF 2,793,411,008 1 entries Q6_K Qwen/Qwen2.5-Coder-3B-Instruct-GGUF 3,616,088,512 1 entries Q8_0 Qwen/Qwen2.5-Coder-3B-Instruct-GGUF 6,800,646,592 1 entries F16 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Task
More from Qwen (Alibaba Cloud)
- Qwen (Alibaba Cloud) Qwen-7B
- Qwen (Alibaba Cloud) Qwen-7B-Chat
- Qwen (Alibaba Cloud) Qwen1.5-0.5B
- Qwen (Alibaba Cloud) Qwen1.5-0.5B-Chat
- Qwen (Alibaba Cloud) Qwen1.5-1.8B-Chat
- Qwen (Alibaba Cloud) Qwen1.5-7B
- Qwen (Alibaba Cloud) Qwen1.5-32B-Chat
- Qwen (Alibaba Cloud) Qwen1.5-MoE-A2.7B
- Qwen (Alibaba Cloud) Qwen1.5-MoE-A2.7B-Chat
- Qwen (Alibaba Cloud) Qwen2-0.5B
- Qwen (Alibaba Cloud) Qwen2-0.5B-Instruct
- Qwen (Alibaba Cloud) Qwen2-1.5B