Meta
Llama 3.1 8B Instruct
Check price at Amazon for Meta Llama 3.1 8B Instruct (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 16 GB
- Weights at 8-bit (Q8_0)
- 8.5 GB
- Weights at 4-bit (Q4_K_M)
- 4.8 GB
- Smallest card at 4-bit
- Intel Arc A380 · 6 GB
- Parameters
- Layers
- KV heads
- Licence
Specs
- Attention heads
- Downloads (30 days)
- Family
- GGUF downloads
-
repo bytes files quant bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 2,948,285,856 1 entries IQ2_M bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 3,179,136,416 1 entries Q2_K bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 3,518,752,160 1 entries IQ3_XS bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 3,664,504,224 1 entries Q3_K_S bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 3,692,160,416 1 entries Q2_K_L bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 3,784,828,320 1 entries IQ3_M bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 4,018,922,912 1 entries Q3_K_M bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 4,321,961,376 1 entries Q3_K_L bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 4,447,667,616 1 entries IQ4_XS bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 4,661,216,672 1 entries Q4_0_4_4 bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 4,661,216,672 1 entries Q4_0_4_8 bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 4,661,216,672 1 entries Q4_0_8_8 bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 4,677,993,888 1 entries IQ4_NL bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 4,692,673,952 1 entries Q4_K_S bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 4,781,630,880 1 entries Q3_K_XL bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 4,920,739,232 1 entries Q4_K_M bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 5,310,637,472 1 entries Q4_K_L bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 5,599,298,976 1 entries Q5_K_S bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 5,732,992,416 1 entries Q5_K_M bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 6,057,223,584 1 entries Q5_K_L bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 6,596,011,424 1 entries Q6_K bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 6,850,471,328 1 entries Q6_K_L bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 8,540,775,840 1 entries Q8_0 bartowski/Meta-Llama-3.1-8B-Instruct-GGUF 32,128,885,888 1 entries F32 - Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Released
- Task