Skip to content
Microsoft

Phi 3.5 Mini Instruct

Maker’s page
Check price at Amazon for Microsoft Phi-3.5-mini-instruct (affiliate link, opens in new tab)
Weights at 16-bit
7.6 GB
Weights at 8-bit (Q8_0)
4.1 GB
Weights at 4-bit (Q4_K_M)
2.3 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
GGUF downloads
repobytesfilesquant
bartowski/Phi-3.5-mini-instruct-GGUF1,316,395,2961 entriesIQ2_M
bartowski/Phi-3.5-mini-instruct-GGUF1,416,204,5761 entriesQ2_K
bartowski/Phi-3.5-mini-instruct-GGUF1,512,396,5761 entriesQ2_K_L
bartowski/Phi-3.5-mini-instruct-GGUF1,625,175,8401 entriesIQ3_XS
bartowski/Phi-3.5-mini-instruct-GGUF1,681,798,9441 entriesQ3_K_S
bartowski/Phi-3.5-mini-instruct-GGUF1,855,600,4161 entriesIQ3_M
bartowski/Phi-3.5-mini-instruct-GGUF1,955,477,2801 entriesQ3_K_M
bartowski/Phi-3.5-mini-instruct-GGUF2,059,853,0881 entriesIQ4_XS
bartowski/Phi-3.5-mini-instruct-GGUF2,087,597,8561 entriesQ3_K_L
bartowski/Phi-3.5-mini-instruct-GGUF2,173,785,8881 entriesQ3_K_XL
bartowski/Phi-3.5-mini-instruct-GGUF2,176,177,4401 entriesQ4_0_4_4
bartowski/Phi-3.5-mini-instruct-GGUF2,176,177,4401 entriesQ4_0_4_8
bartowski/Phi-3.5-mini-instruct-GGUF2,176,177,4401 entriesQ4_0_8_8
bartowski/Phi-3.5-mini-instruct-GGUF2,182,468,8961 entriesQ4_0
bartowski/Phi-3.5-mini-instruct-GGUF2,188,760,3521 entriesQ4_K_S
bartowski/Phi-3.5-mini-instruct-GGUF2,393,232,6721 entriesQ4_K_M
bartowski/Phi-3.5-mini-instruct-GGUF2,466,338,5921 entriesQ4_K_L
bartowski/Phi-3.5-mini-instruct-GGUF2,641,474,8481 entriesQ5_K_S
bartowski/Phi-3.5-mini-instruct-GGUF2,815,276,3201 entriesQ5_K_M
bartowski/Phi-3.5-mini-instruct-GGUF2,876,069,6641 entriesQ5_K_L
bartowski/Phi-3.5-mini-instruct-GGUF3,135,853,3441 entriesQ6_K
bartowski/Phi-3.5-mini-instruct-GGUF3,183,564,5761 entriesQ6_K_L
bartowski/Phi-3.5-mini-instruct-GGUF4,061,222,6881 entriesQ8_0
bartowski/Phi-3.5-mini-instruct-GGUF15,285,057,0241 entriesF32
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Sliding window
Task

More from Microsoft