Microsoft
Phi 3.5 Mini Instruct
Check price at Amazon for Microsoft Phi-3.5-mini-instruct (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 7.6 GB
- Weights at 8-bit (Q8_0)
- 4.1 GB
- Weights at 4-bit (Q4_K_M)
- 2.3 GB
- Smallest card at 4-bit
- Intel Arc A380 · 6 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- GGUF downloads
-
repo bytes files quant bartowski/Phi-3.5-mini-instruct-GGUF 1,316,395,296 1 entries IQ2_M bartowski/Phi-3.5-mini-instruct-GGUF 1,416,204,576 1 entries Q2_K bartowski/Phi-3.5-mini-instruct-GGUF 1,512,396,576 1 entries Q2_K_L bartowski/Phi-3.5-mini-instruct-GGUF 1,625,175,840 1 entries IQ3_XS bartowski/Phi-3.5-mini-instruct-GGUF 1,681,798,944 1 entries Q3_K_S bartowski/Phi-3.5-mini-instruct-GGUF 1,855,600,416 1 entries IQ3_M bartowski/Phi-3.5-mini-instruct-GGUF 1,955,477,280 1 entries Q3_K_M bartowski/Phi-3.5-mini-instruct-GGUF 2,059,853,088 1 entries IQ4_XS bartowski/Phi-3.5-mini-instruct-GGUF 2,087,597,856 1 entries Q3_K_L bartowski/Phi-3.5-mini-instruct-GGUF 2,173,785,888 1 entries Q3_K_XL bartowski/Phi-3.5-mini-instruct-GGUF 2,176,177,440 1 entries Q4_0_4_4 bartowski/Phi-3.5-mini-instruct-GGUF 2,176,177,440 1 entries Q4_0_4_8 bartowski/Phi-3.5-mini-instruct-GGUF 2,176,177,440 1 entries Q4_0_8_8 bartowski/Phi-3.5-mini-instruct-GGUF 2,182,468,896 1 entries Q4_0 bartowski/Phi-3.5-mini-instruct-GGUF 2,188,760,352 1 entries Q4_K_S bartowski/Phi-3.5-mini-instruct-GGUF 2,393,232,672 1 entries Q4_K_M bartowski/Phi-3.5-mini-instruct-GGUF 2,466,338,592 1 entries Q4_K_L bartowski/Phi-3.5-mini-instruct-GGUF 2,641,474,848 1 entries Q5_K_S bartowski/Phi-3.5-mini-instruct-GGUF 2,815,276,320 1 entries Q5_K_M bartowski/Phi-3.5-mini-instruct-GGUF 2,876,069,664 1 entries Q5_K_L bartowski/Phi-3.5-mini-instruct-GGUF 3,135,853,344 1 entries Q6_K bartowski/Phi-3.5-mini-instruct-GGUF 3,183,564,576 1 entries Q6_K_L bartowski/Phi-3.5-mini-instruct-GGUF 4,061,222,688 1 entries Q8_0 bartowski/Phi-3.5-mini-instruct-GGUF 15,285,057,024 1 entries F32 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Sliding window
- Task
More from Microsoft
- Microsoft maira-2
- Microsoft phi-1_5
- Microsoft phi-2
- Microsoft Phi-3 Medium 4K Instruct
- Microsoft Phi-3 Mini 4K Instruct
- Microsoft Phi-3-mini-128k-instruct
- Microsoft Phi-3-vision-128k-instruct
- Microsoft Phi-3.5-MoE-instruct
- Microsoft Phi-4
- Microsoft Phi-4 Mini Instruct
- Microsoft Phi-4-mini-reasoning
- Microsoft Phi-4-reasoning