Skip to content
NousResearch

Hermes 3 Llama 3.1 8B

Maker’s page
Check price at Amazon for NousResearch Hermes-3-Llama-3.1-8B (affiliate link, opens in new tab)
Weights at 16-bit
16 GB
Weights at 8-bit (Q8_0)
8.5 GB
Weights at 4-bit (Q4_K_M)
4.9 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
GGUF downloads
repobytesfilesquant
bartowski/Hermes-3-Llama-3.1-8B-GGUF2,948,281,2481 entriesIQ2_M
bartowski/Hermes-3-Llama-3.1-8B-GGUF3,179,131,8081 entriesQ2_K
bartowski/Hermes-3-Llama-3.1-8B-GGUF3,518,747,5521 entriesIQ3_XS
bartowski/Hermes-3-Llama-3.1-8B-GGUF3,664,499,6161 entriesQ3_K_S
bartowski/Hermes-3-Llama-3.1-8B-GGUF3,692,155,8081 entriesQ2_K_L
bartowski/Hermes-3-Llama-3.1-8B-GGUF3,784,823,7121 entriesIQ3_M
bartowski/Hermes-3-Llama-3.1-8B-GGUF4,018,918,3041 entriesQ3_K_M
bartowski/Hermes-3-Llama-3.1-8B-GGUF4,321,956,7681 entriesQ3_K_L
bartowski/Hermes-3-Llama-3.1-8B-GGUF4,447,663,0081 entriesIQ4_XS
bartowski/Hermes-3-Llama-3.1-8B-GGUF4,692,669,3441 entriesQ4_K_S
bartowski/Hermes-3-Llama-3.1-8B-GGUF4,781,626,2721 entriesQ3_K_XL
bartowski/Hermes-3-Llama-3.1-8B-GGUF4,920,734,6241 entriesQ4_K_M
bartowski/Hermes-3-Llama-3.1-8B-GGUF5,310,632,8641 entriesQ4_K_L
bartowski/Hermes-3-Llama-3.1-8B-GGUF5,599,294,3681 entriesQ5_K_S
bartowski/Hermes-3-Llama-3.1-8B-GGUF5,732,987,8081 entriesQ5_K_M
bartowski/Hermes-3-Llama-3.1-8B-GGUF6,057,218,9761 entriesQ5_K_L
bartowski/Hermes-3-Llama-3.1-8B-GGUF6,596,006,8161 entriesQ6_K
bartowski/Hermes-3-Llama-3.1-8B-GGUF6,850,466,7201 entriesQ6_K_L
bartowski/Hermes-3-Llama-3.1-8B-GGUF8,540,771,2321 entriesQ8_0
bartowski/Hermes-3-Llama-3.1-8B-GGUF32,128,881,2801 entriesF32
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Task

More from NousResearch