Skip to content
Qwen

Qwen2 7B Instruct

Maker’s page
Check price at Amazon for Qwen (Alibaba Cloud) Qwen2-7B-Instruct (affiliate link, opens in new tab)
Weights at 16-bit
15 GB
Weights at 8-bit (Q8_0)
8.1 GB
Weights at 4-bit (Q4_K_M)
4.6 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
GGUF downloads
repobytesfilesquant
Qwen/Qwen2-7B-Instruct-GGUF3,015,937,8241 entriesQ2_K
Qwen/Qwen2-7B-Instruct-GGUF3,808,388,8961 entriesQ3_K_M
Qwen/Qwen2-7B-Instruct-GGUF4,444,118,8161 entriesQ4_0
Qwen/Qwen2-7B-Instruct-GGUF4,683,071,2641 entriesQ4_K_M
Qwen/Qwen2-7B-Instruct-GGUF5,327,904,5441 entriesQ5_0
Qwen/Qwen2-7B-Instruct-GGUF5,444,828,9601 entriesQ5_K_M
Qwen/Qwen2-7B-Instruct-GGUF6,254,196,5121 entriesQ6_K
Qwen/Qwen2-7B-Instruct-GGUF8,098,522,9121 entriesQ8_0
Qwen/Qwen2-7B-Instruct-GGUF15,237,850,6881 entriesF16
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Task

More from Qwen (Alibaba Cloud)