Skip to content
Meta

Llama 3.3 70B Instruct

Maker’s page
Check price at Amazon for Meta Llama 3.3 70B Instruct (affiliate link, opens in new tab)
Weights at 16-bit
140 GB
Weights at 8-bit (Q8_0)
74 GB
Weights at 4-bit (Q4_K_M)
42 GB
Smallest card at 4-bit
RTX 6000 Ada Generation · 48 GB
Parameters
Layers
KV heads
Licence

Specs

Attention heads
Downloads (30 days)
Family
GGUF downloads
repobytesfilesquant
bartowski/Llama-3.3-70B-Instruct-GGUF16,751,201,2481 entriesIQ1_M
bartowski/Llama-3.3-70B-Instruct-GGUF19,097,390,0481 entriesIQ2_XXS
bartowski/Llama-3.3-70B-Instruct-GGUF21,142,113,2481 entriesIQ2_XS
bartowski/Llama-3.3-70B-Instruct-GGUF22,242,348,0001 entriesIQ2_S
bartowski/Llama-3.3-70B-Instruct-GGUF24,119,299,0401 entriesIQ2_M
bartowski/Llama-3.3-70B-Instruct-GGUF26,375,113,6961 entriesQ2_K
bartowski/Llama-3.3-70B-Instruct-GGUF27,401,161,6961 entriesQ2_K_L
bartowski/Llama-3.3-70B-Instruct-GGUF27,469,499,3601 entriesIQ3_XXS
bartowski/Llama-3.3-70B-Instruct-GGUF29,307,735,0081 entriesIQ3_XS
bartowski/Llama-3.3-70B-Instruct-GGUF30,912,056,2881 entriesQ3_K_S
bartowski/Llama-3.3-70B-Instruct-GGUF31,937,039,3281 entriesIQ3_M
bartowski/Llama-3.3-70B-Instruct-GGUF34,267,499,4881 entriesQ3_K_M
bartowski/Llama-3.3-70B-Instruct-GGUF37,140,597,7281 entriesQ3_K_L
bartowski/Llama-3.3-70B-Instruct-GGUF37,902,666,7201 entriesIQ4_XS
bartowski/Llama-3.3-70B-Instruct-GGUF38,059,936,7361 entriesQ3_K_XL
bartowski/Llama-3.3-70B-Instruct-GGUF39,969,737,6961 entriesQ4_0_4_4
bartowski/Llama-3.3-70B-Instruct-GGUF39,969,737,6961 entriesQ4_0_4_8
bartowski/Llama-3.3-70B-Instruct-GGUF39,969,737,6961 entriesQ4_0_8_8
bartowski/Llama-3.3-70B-Instruct-GGUF40,053,623,7761 entriesIQ4_NL
bartowski/Llama-3.3-70B-Instruct-GGUF40,116,538,3361 entriesQ4_0
bartowski/Llama-3.3-70B-Instruct-GGUF40,347,225,0561 entriesQ4_K_S
bartowski/Llama-3.3-70B-Instruct-GGUF42,520,398,8161 entriesQ4_K_M
bartowski/Llama-3.3-70B-Instruct-GGUF43,300,195,2961 entriesQ4_K_L
bartowski/Llama-3.3-70B-Instruct-GGUF48,657,452,0001 entriesQ5_K_S
bartowski/Llama-3.3-70B-Instruct-GGUF49,949,822,1122 entriesQ5_K_M
bartowski/Llama-3.3-70B-Instruct-GGUF50,598,284,4482 entriesQ5_K_L
bartowski/Llama-3.3-70B-Instruct-GGUF57,888,148,6722 entriesQ6_K
bartowski/Llama-3.3-70B-Instruct-GGUF58,397,068,4482 entriesQ6_K_L
bartowski/Llama-3.3-70B-Instruct-GGUF74,975,055,0082 entriesQ8_0
bartowski/Llama-3.3-70B-Instruct-GGUF141,117,918,6244 entriesF16
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Released
Task

More from Meta

Across the range 5 models by family