Skip to content
Microsoft

Phi-3 Mini 4K Instruct

Maker’s page
Check price at Amazon for Microsoft Phi-3 Mini 4K Instruct (affiliate link, opens in new tab)
Weights at 16-bit
7.6 GB
Weights at 8-bit (Q8_0)
4.0 GB
Weights at 4-bit (Q4_K_M)
2.3 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
Family
GGUF downloads
repobytesfilesquant
bartowski/Phi-3-mini-4k-instruct-v0.3-GGUF1,153,035,8721 entriesIQ2_XS
bartowski/Phi-3-mini-4k-instruct-v0.3-GGUF1,215,730,7841 entriesIQ2_S
bartowski/Phi-3-mini-4k-instruct-v0.3-GGUF1,316,394,0801 entriesIQ2_M
bartowski/Phi-3-mini-4k-instruct-v0.3-GGUF1,416,203,3601 entriesQ2_K
bartowski/Phi-3-mini-4k-instruct-v0.3-GGUF1,513,002,0801 entriesIQ3_XXS
bartowski/Phi-3-mini-4k-instruct-v0.3-GGUF1,625,174,6241 entriesIQ3_XS
bartowski/Phi-3-mini-4k-instruct-v0.3-GGUF1,681,797,7281 entriesQ3_K_S
bartowski/Phi-3-mini-4k-instruct-v0.3-GGUF1,855,599,2001 entriesIQ3_M
bartowski/Phi-3-mini-4k-instruct-v0.3-GGUF1,955,476,0641 entriesQ3_K_M
bartowski/Phi-3-mini-4k-instruct-v0.3-GGUF2,059,851,8721 entriesIQ4_XS
bartowski/Phi-3-mini-4k-instruct-v0.3-GGUF2,087,596,6401 entriesQ3_K_L
bartowski/Phi-3-mini-4k-instruct-v0.3-GGUF2,188,759,1361 entriesQ4_K_S
bartowski/Phi-3-mini-4k-instruct-v0.3-GGUF2,393,231,4561 entriesQ4_K_M
bartowski/Phi-3-mini-4k-instruct-v0.3-GGUF2,641,473,6321 entriesQ5_K_S
bartowski/Phi-3-mini-4k-instruct-v0.3-GGUF2,815,275,1041 entriesQ5_K_M
bartowski/Phi-3-mini-4k-instruct-v0.3-GGUF3,135,852,1281 entriesQ6_K
bartowski/Phi-3-mini-4k-instruct-v0.3-GGUF4,061,221,4721 entriesQ8_0
bartowski/Phi-3-mini-4k-instruct-v0.3-GGUF15,285,055,8081 entriesF32
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Released
Sliding window
Task

More from Microsoft

Across the range 4 models by family