NousResearch
Hermes 3 Llama 3.1 8B
Check price at Amazon for NousResearch Hermes-3-Llama-3.1-8B (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 16 GB
- Weights at 8-bit (Q8_0)
- 8.5 GB
- Weights at 4-bit (Q4_K_M)
- 4.9 GB
- Smallest card at 4-bit
- Intel Arc A380 · 6 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- GGUF downloads
-
repo bytes files quant bartowski/Hermes-3-Llama-3.1-8B-GGUF 2,948,281,248 1 entries IQ2_M bartowski/Hermes-3-Llama-3.1-8B-GGUF 3,179,131,808 1 entries Q2_K bartowski/Hermes-3-Llama-3.1-8B-GGUF 3,518,747,552 1 entries IQ3_XS bartowski/Hermes-3-Llama-3.1-8B-GGUF 3,664,499,616 1 entries Q3_K_S bartowski/Hermes-3-Llama-3.1-8B-GGUF 3,692,155,808 1 entries Q2_K_L bartowski/Hermes-3-Llama-3.1-8B-GGUF 3,784,823,712 1 entries IQ3_M bartowski/Hermes-3-Llama-3.1-8B-GGUF 4,018,918,304 1 entries Q3_K_M bartowski/Hermes-3-Llama-3.1-8B-GGUF 4,321,956,768 1 entries Q3_K_L bartowski/Hermes-3-Llama-3.1-8B-GGUF 4,447,663,008 1 entries IQ4_XS bartowski/Hermes-3-Llama-3.1-8B-GGUF 4,692,669,344 1 entries Q4_K_S bartowski/Hermes-3-Llama-3.1-8B-GGUF 4,781,626,272 1 entries Q3_K_XL bartowski/Hermes-3-Llama-3.1-8B-GGUF 4,920,734,624 1 entries Q4_K_M bartowski/Hermes-3-Llama-3.1-8B-GGUF 5,310,632,864 1 entries Q4_K_L bartowski/Hermes-3-Llama-3.1-8B-GGUF 5,599,294,368 1 entries Q5_K_S bartowski/Hermes-3-Llama-3.1-8B-GGUF 5,732,987,808 1 entries Q5_K_M bartowski/Hermes-3-Llama-3.1-8B-GGUF 6,057,218,976 1 entries Q5_K_L bartowski/Hermes-3-Llama-3.1-8B-GGUF 6,596,006,816 1 entries Q6_K bartowski/Hermes-3-Llama-3.1-8B-GGUF 6,850,466,720 1 entries Q6_K_L bartowski/Hermes-3-Llama-3.1-8B-GGUF 8,540,771,232 1 entries Q8_0 bartowski/Hermes-3-Llama-3.1-8B-GGUF 32,128,881,280 1 entries F32 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Task