Microsoft
Phi-3 Medium 4K Instruct
Check price at Amazon for Microsoft Phi-3 Medium 4K Instruct (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 28 GB
- Weights at 8-bit (Q8_0)
- 15 GB
- Weights at 4-bit (Q4_K_M)
- 8.5 GB
- Smallest card at 4-bit
- Intel Arc B570 · 10 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- Family
- GGUF downloads
-
repo bytes files quant bartowski/Phi-3-medium-4k-instruct-GGUF 4,717,006,208 1 entries IQ2_M bartowski/Phi-3-medium-4k-instruct-GGUF 5,143,000,448 1 entries Q2_K bartowski/Phi-3-medium-4k-instruct-GGUF 5,303,320,448 1 entries Q2_K_L bartowski/Phi-3-medium-4k-instruct-GGUF 5,806,841,728 1 entries IQ3_XS bartowski/Phi-3-medium-4k-instruct-GGUF 6,064,889,728 1 entries Q3_K_S bartowski/Phi-3-medium-4k-instruct-GGUF 6,473,977,728 1 entries IQ3_M bartowski/Phi-3-medium-4k-instruct-GGUF 6,923,411,328 1 entries Q3_K_M bartowski/Phi-3-medium-4k-instruct-GGUF 7,466,011,008 1 entries IQ4_XS bartowski/Phi-3-medium-4k-instruct-GGUF 7,490,297,728 1 entries Q3_K_L bartowski/Phi-3-medium-4k-instruct-GGUF 7,633,944,448 1 entries Q3_K_XL bartowski/Phi-3-medium-4k-instruct-GGUF 7,954,469,248 1 entries Q4_K_S bartowski/Phi-3-medium-4k-instruct-GGUF 8,566,821,248 1 entries Q4_K_M bartowski/Phi-3-medium-4k-instruct-GGUF 8,688,664,448 1 entries Q4_K_L bartowski/Phi-3-medium-4k-instruct-GGUF 9,621,582,208 1 entries Q5_K_S bartowski/Phi-3-medium-4k-instruct-GGUF 10,074,190,208 1 entries Q5_K_M bartowski/Phi-3-medium-4k-instruct-GGUF 10,175,512,448 1 entries Q5_K_L bartowski/Phi-3-medium-4k-instruct-GGUF 11,453,817,728 1 entries Q6_K bartowski/Phi-3-medium-4k-instruct-GGUF 11,533,336,448 1 entries Q6_K_L bartowski/Phi-3-medium-4k-instruct-GGUF 14,834,712,448 1 entries Q8_0 bartowski/Phi-3-medium-4k-instruct-GGUF 55,841,693,504 2 entries F32 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Released
- Sliding window
- Task
More from Microsoft
- Microsoft maira-2
- Microsoft phi-1_5
- Microsoft phi-2
- Microsoft Phi-3 Mini 4K Instruct
- Microsoft Phi-3-mini-128k-instruct
- Microsoft Phi-3-vision-128k-instruct
- Microsoft Phi-3.5-mini-instruct
- Microsoft Phi-3.5-MoE-instruct
- Microsoft Phi-4
- Microsoft Phi-4 Mini Instruct
- Microsoft Phi-4-mini-reasoning
- Microsoft Phi-4-reasoning