Skip to content
Meta

Llama 3.2 1B Instruct

Maker’s page
Check price at Amazon for Meta Llama-3.2-1B-Instruct (affiliate link, opens in new tab)
Weights at 16-bit
2.5 GB
Weights at 8-bit (Q8_0)
1.3 GB
Weights at 4-bit (Q4_K_M)
0.8 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB

Specs

Downloads (30 days)
GGUF downloads
repobytesfilesquant
bartowski/Llama-3.2-1B-Instruct-GGUF657,289,3441 entriesIQ3_M
bartowski/Llama-3.2-1B-Instruct-GGUF732,524,6721 entriesQ3_K_L
bartowski/Llama-3.2-1B-Instruct-GGUF743,141,5041 entriesIQ4_XS
bartowski/Llama-3.2-1B-Instruct-GGUF770,928,7681 entriesQ4_0_4_4
bartowski/Llama-3.2-1B-Instruct-GGUF770,928,7681 entriesQ4_0_4_8
bartowski/Llama-3.2-1B-Instruct-GGUF770,928,7681 entriesQ4_0_8_8
bartowski/Llama-3.2-1B-Instruct-GGUF773,025,9201 entriesQ4_0
bartowski/Llama-3.2-1B-Instruct-GGUF775,647,3601 entriesQ4_K_S
bartowski/Llama-3.2-1B-Instruct-GGUF796,139,6481 entriesQ3_K_XL
bartowski/Llama-3.2-1B-Instruct-GGUF807,694,4641 entriesQ4_K_M
bartowski/Llama-3.2-1B-Instruct-GGUF871,309,4401 entriesQ4_K_L
bartowski/Llama-3.2-1B-Instruct-GGUF892,563,5841 entriesQ5_K_S
bartowski/Llama-3.2-1B-Instruct-GGUF911,503,4881 entriesQ5_K_M
bartowski/Llama-3.2-1B-Instruct-GGUF975,118,4641 entriesQ5_K_L
bartowski/Llama-3.2-1B-Instruct-GGUF1,021,800,5761 entriesQ6_K
bartowski/Llama-3.2-1B-Instruct-GGUF1,085,415,5521 entriesQ6_K_L
bartowski/Llama-3.2-1B-Instruct-GGUF1,321,083,0081 entriesQ8_0
bartowski/Llama-3.2-1B-Instruct-GGUF2,479,595,3601 entriesF16
Licence
Parameters
Parameters by type
Publisher
Task

More from Meta