Qwen
Qwen2.5 72B Instruct
Check price at Amazon for Qwen (Alibaba Cloud) Qwen2.5 72B Instruct (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 145 GB
- Weights at 8-bit (Q8_0)
- 77 GB
- Weights at 4-bit (Q4_K_M)
- 44 GB
- Smallest card at 4-bit
- RTX 6000 Ada Generation · 48 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- Family
- GGUF downloads
-
repo bytes files quant bartowski/Qwen2.5-72B-Instruct-GGUF 23,740,212,896 1 entries IQ1_M bartowski/Qwen2.5-72B-Instruct-GGUF 25,490,024,096 1 entries IQ2_XXS bartowski/Qwen2.5-72B-Instruct-GGUF 27,057,645,216 1 entries IQ2_XS bartowski/Qwen2.5-72B-Instruct-GGUF 29,338,986,144 1 entries IQ2_M bartowski/Qwen2.5-72B-Instruct-GGUF 29,811,762,848 1 entries Q2_K bartowski/Qwen2.5-72B-Instruct-GGUF 31,028,274,848 1 entries Q2_K_L bartowski/Qwen2.5-72B-Instruct-GGUF 31,845,082,784 1 entries IQ3_XXS bartowski/Qwen2.5-72B-Instruct-GGUF 34,487,789,216 1 entries Q3_K_S bartowski/Qwen2.5-72B-Instruct-GGUF 35,503,597,216 1 entries IQ3_M bartowski/Qwen2.5-72B-Instruct-GGUF 37,698,725,536 1 entries Q3_K_M bartowski/Qwen2.5-72B-Instruct-GGUF 39,505,225,376 1 entries Q3_K_L bartowski/Qwen2.5-72B-Instruct-GGUF 39,709,075,104 1 entries IQ4_XS bartowski/Qwen2.5-72B-Instruct-GGUF 40,595,220,128 1 entries Q3_K_XL bartowski/Qwen2.5-72B-Instruct-GGUF 41,383,126,688 1 entries Q4_0 bartowski/Qwen2.5-72B-Instruct-GGUF 47,415,715,488 1 entries Q4_K_M bartowski/Qwen2.5-72B-Instruct-GGUF 54,447,466,336 2 entries Q5_K_M bartowski/Qwen2.5-72B-Instruct-GGUF 64,347,629,408 2 entries Q6_K bartowski/Qwen2.5-72B-Instruct-GGUF 77,262,612,320 2 entries Q8_0 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Released
- Task