Skip to content
Tencent

Hy3

Maker’s page
Check price at Amazon for tencent Hy3 (affiliate link, opens in new tab)
Weights at 16-bit
598 GB
Weights at 8-bit (Q8_0)
317 GB
Weights at 4-bit (Q4_K_M)
181 GB
Smallest card at 4-bit
More than one card
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
Experts
Experts per token
GGUF downloads
repobytesfilesquant
bartowski/Hy3-GGUF64,051,148,3522 entriesIQ1_S
bartowski/Hy3-GGUF71,100,724,8002 entriesIQ1_M
bartowski/Hy3-GGUF82,113,918,6563 entriesIQ2_XXS
bartowski/Hy3-GGUF91,060,369,1203 entriesIQ2_XS
bartowski/Hy3-GGUF92,805,134,0163 entriesIQ2_S
bartowski/Hy3-GGUF102,091,323,1043 entriesIQ2_M
bartowski/Hy3-GGUF106,691,229,3763 entriesQ2_K
bartowski/Hy3-GGUF107,174,557,4083 entriesQ2_K_L
bartowski/Hy3-GGUF126,089,361,2484 entriesIQ3_XXS
bartowski/Hy3-GGUF131,274,569,5364 entriesQ3_K_S
bartowski/Hy3-GGUF137,437,050,6564 entriesIQ3_XS
bartowski/Hy3-GGUF137,545,479,9684 entriesQ3_K_M
bartowski/Hy3-GGUF143,077,766,9764 entriesQ3_K_L
bartowski/Hy3-GGUF143,510,828,8644 entriesQ3_K_XL
bartowski/Hy3-GGUF143,668,639,5844 entriesIQ3_M
bartowski/Hy3-GGUF160,771,307,4565 entriesIQ4_XS
bartowski/Hy3-GGUF169,803,872,1925 entriesIQ4_NL
bartowski/Hy3-GGUF170,321,082,3365 entriesQ4_0
bartowski/Hy3-GGUF175,458,318,3045 entriesQ4_K_S
bartowski/Hy3-GGUF182,158,227,3605 entriesQ4_K_M
bartowski/Hy3-GGUF182,525,556,6405 entriesQ4_K_L
bartowski/Hy3-GGUF187,795,601,3445 entriesQ4_1
bartowski/Hy3-GGUF206,034,401,3446 entriesQ5_K_S
bartowski/Hy3-GGUF212,837,857,3446 entriesQ5_K_M
bartowski/Hy3-GGUF257,246,623,9367 entriesQ6_K
bartowski/Hy3-GGUF317,652,367,7769 entriesQ8_0
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Shared experts
Task

More from tencent