Skip to content
Qwen

Qwen2.5 Coder 7B Instruct

Maker’s page
Check price at Amazon for Qwen (Alibaba Cloud) Qwen2.5-Coder-7B-Instruct (affiliate link, opens in new tab)
Weights at 16-bit
15 GB
Weights at 8-bit (Q8_0)
8.1 GB
Weights at 4-bit (Q4_K_M)
4.6 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
GGUF downloads
repobytesfilesquant
Qwen/Qwen2.5-Coder-7B-Instruct-GGUF3,015,940,0321 entriesQ2_K
Qwen/Qwen2.5-Coder-7B-Instruct-GGUF3,808,391,1041 entriesQ3_K_M
Qwen/Qwen2.5-Coder-7B-Instruct-GGUF4,879,553,2163 entriesQ4_0
Qwen/Qwen2.5-Coder-7B-Instruct-GGUF5,315,176,5762 entriesQ5_0
Qwen/Qwen2.5-Coder-7B-Instruct-GGUF5,372,945,8243 entriesQ4_K_M
Qwen/Qwen2.5-Coder-7B-Instruct-GGUF6,899,820,8003 entriesQ5_K_M
Qwen/Qwen2.5-Coder-7B-Instruct-GGUF8,557,755,2003 entriesQ6_K
Qwen/Qwen2.5-Coder-7B-Instruct-GGUF12,216,981,3444 entriesQ8_0
Qwen/Qwen2.5-Coder-7B-Instruct-GGUF26,524,185,3445 entriesF16
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Task

More from Qwen (Alibaba Cloud)