Skip to content
Meta

Llama 3.2 3B Instruct

Maker’s page
Check price at Amazon for Meta Llama-3.2-3B-Instruct (affiliate link, opens in new tab)
Weights at 16-bit
6.4 GB
Weights at 8-bit (Q8_0)
3.4 GB
Weights at 4-bit (Q4_K_M)
1.9 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB

Specs

Downloads (30 days)
GGUF downloads
repobytesfilesquant
unsloth/Llama-3.2-3B-Instruct-GGUF912,345,5361 entriesUD-IQ1_S
unsloth/Llama-3.2-3B-Instruct-GGUF960,416,1921 entriesUD-IQ1_M
unsloth/Llama-3.2-3B-Instruct-GGUF1,046,579,6481 entriesUD-IQ2_XXS
unsloth/Llama-3.2-3B-Instruct-GGUF1,256,262,0801 entriesUD-IQ2_M
unsloth/Llama-3.2-3B-Instruct-GGUF1,363,935,6801 entriesQ2_K
unsloth/Llama-3.2-3B-Instruct-GGUF1,363,935,6801 entriesQ2_K_L
unsloth/Llama-3.2-3B-Instruct-GGUF1,370,147,2641 entriesUD-IQ3_XXS
unsloth/Llama-3.2-3B-Instruct-GGUF1,403,380,1601 entriesUD-Q2_K_XL
unsloth/Llama-3.2-3B-Instruct-GGUF1,542,848,9601 entriesQ3_K_S
unsloth/Llama-3.2-3B-Instruct-GGUF1,687,159,2321 entriesQ3_K_M
unsloth/Llama-3.2-3B-Instruct-GGUF1,742,430,6561 entriesUD-Q3_K_XL
unsloth/Llama-3.2-3B-Instruct-GGUF1,829,110,2081 entriesIQ4_XS
unsloth/Llama-3.2-3B-Instruct-GGUF1,917,190,5921 entriesIQ4_NL
unsloth/Llama-3.2-3B-Instruct-GGUF1,921,909,1841 entriesQ4_0
unsloth/Llama-3.2-3B-Instruct-GGUF1,928,200,6401 entriesQ4_K_S
unsloth/Llama-3.2-3B-Instruct-GGUF2,019,377,6001 entriesQ4_K_M
unsloth/Llama-3.2-3B-Instruct-GGUF2,060,886,4641 entriesUD-Q4_K_XL
unsloth/Llama-3.2-3B-Instruct-GGUF2,093,351,3601 entriesQ4_1
unsloth/Llama-3.2-3B-Instruct-GGUF2,269,512,1281 entriesQ5_K_S
unsloth/Llama-3.2-3B-Instruct-GGUF2,322,153,9201 entriesQ5_K_M
unsloth/Llama-3.2-3B-Instruct-GGUF2,327,781,8241 entriesUD-Q5_K_XL
unsloth/Llama-3.2-3B-Instruct-GGUF2,643,853,7601 entriesQ6_K
unsloth/Llama-3.2-3B-Instruct-GGUF2,967,833,0241 entriesUD-Q6_K_XL
unsloth/Llama-3.2-3B-Instruct-GGUF3,421,898,8161 entriesQ8_0
unsloth/Llama-3.2-3B-Instruct-GGUF4,204,153,2801 entriesUD-Q8_K_XL
unsloth/Llama-3.2-3B-Instruct-GGUF6,433,687,6161 entriesF16
unsloth/Llama-3.2-3B-Instruct-GGUF6,433,687,7441 entriesBF16
Licence
Parameters
Parameters by type
Publisher
Task

More from Meta