Qwen
Qwen2.5 14B Instruct
Check price at Amazon for Qwen (Alibaba Cloud) Qwen2.5 14B Instruct (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 29 GB
- Weights at 8-bit (Q8_0)
- 16 GB
- Weights at 4-bit (Q4_K_M)
- 8.9 GB
- Smallest card at 4-bit
- Intel Arc B570 · 10 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- Family
- GGUF downloads
-
repo bytes files quant bartowski/Qwen2.5-14B-Instruct-GGUF 5,356,146,816 1 entries IQ2_M bartowski/Qwen2.5-14B-Instruct-GGUF 5,770,498,176 1 entries Q2_K bartowski/Qwen2.5-14B-Instruct-GGUF 6,383,362,176 1 entries IQ3_XS bartowski/Qwen2.5-14B-Instruct-GGUF 6,530,818,176 1 entries Q2_K_L bartowski/Qwen2.5-14B-Instruct-GGUF 6,659,596,416 1 entries Q3_K_S bartowski/Qwen2.5-14B-Instruct-GGUF 6,916,538,496 1 entries IQ3_M bartowski/Qwen2.5-14B-Instruct-GGUF 7,339,204,736 1 entries Q3_K_M bartowski/Qwen2.5-14B-Instruct-GGUF 7,924,768,896 1 entries Q3_K_L bartowski/Qwen2.5-14B-Instruct-GGUF 8,119,840,896 1 entries IQ4_XS bartowski/Qwen2.5-14B-Instruct-GGUF 8,517,726,336 1 entries Q4_0_4_4 bartowski/Qwen2.5-14B-Instruct-GGUF 8,517,726,336 1 entries Q4_0_4_8 bartowski/Qwen2.5-14B-Instruct-GGUF 8,517,726,336 1 entries Q4_0_8_8 bartowski/Qwen2.5-14B-Instruct-GGUF 8,544,268,416 1 entries Q4_0 bartowski/Qwen2.5-14B-Instruct-GGUF 8,573,431,936 1 entries Q4_K_S bartowski/Qwen2.5-14B-Instruct-GGUF 8,606,015,616 1 entries Q3_K_XL bartowski/Qwen2.5-14B-Instruct-GGUF 8,988,110,976 1 entries Q4_K_M bartowski/Qwen2.5-14B-Instruct-GGUF 9,565,954,176 1 entries Q4_K_L bartowski/Qwen2.5-14B-Instruct-GGUF 10,266,554,496 1 entries Q5_K_S bartowski/Qwen2.5-14B-Instruct-GGUF 10,508,873,856 1 entries Q5_K_M bartowski/Qwen2.5-14B-Instruct-GGUF 10,989,396,096 1 entries Q5_K_L bartowski/Qwen2.5-14B-Instruct-GGUF 12,124,684,416 1 entries Q6_K bartowski/Qwen2.5-14B-Instruct-GGUF 12,501,803,136 1 entries Q6_K_L bartowski/Qwen2.5-14B-Instruct-GGUF 15,701,598,336 1 entries Q8_0 bartowski/Qwen2.5-14B-Instruct-GGUF 29,547,716,448 1 entries F16 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Released
- Task