Skip to content
Google

Gemma 2 9B IT

Maker’s page
Check price at Amazon for Google Gemma 2 9B IT (affiliate link, opens in new tab)
Weights at 16-bit
18 GB
Weights at 8-bit (Q8_0)
9.8 GB
Weights at 4-bit (Q4_K_M)
5.6 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB
Parameters
Layers
KV heads
Licence

Specs

Attention heads
Downloads (30 days)
Family
GGUF downloads
repobytesfilesquant
bartowski/gemma-2-9b-it-GGUF3,067,381,6321 entriesIQ2_XS
bartowski/gemma-2-9b-it-GGUF3,211,487,1041 entriesIQ2_S
bartowski/gemma-2-9b-it-GGUF3,434,668,9921 entriesIQ2_M
bartowski/gemma-2-9b-it-GGUF3,796,739,0081 entriesIQ3_XXS
bartowski/gemma-2-9b-it-GGUF3,805,397,9521 entriesQ2_K
bartowski/gemma-2-9b-it-GGUF4,027,605,9521 entriesQ2_K_L
bartowski/gemma-2-9b-it-GGUF4,144,989,1201 entriesIQ3_XS
bartowski/gemma-2-9b-it-GGUF4,337,664,9601 entriesQ3_K_S
bartowski/gemma-2-9b-it-GGUF4,494,615,4881 entriesIQ3_M
bartowski/gemma-2-9b-it-GGUF4,761,781,1841 entriesQ3_K_M
bartowski/gemma-2-9b-it-GGUF5,132,452,8001 entriesQ3_K_L
bartowski/gemma-2-9b-it-GGUF5,183,030,2081 entriesIQ4_XS
bartowski/gemma-2-9b-it-GGUF5,354,660,7681 entriesQ3_K_XL
bartowski/gemma-2-9b-it-GGUF5,478,925,2481 entriesQ4_K_S
bartowski/gemma-2-9b-it-GGUF5,761,057,7281 entriesQ4_K_M
bartowski/gemma-2-9b-it-GGUF5,983,265,7281 entriesQ4_K_L
bartowski/gemma-2-9b-it-GGUF6,483,592,1281 entriesQ5_K_S
bartowski/gemma-2-9b-it-GGUF6,647,366,5921 entriesQ5_K_M
bartowski/gemma-2-9b-it-GGUF6,843,425,6961 entriesF16
bartowski/gemma-2-9b-it-GGUF6,869,574,5921 entriesQ5_K_L
bartowski/gemma-2-9b-it-GGUF7,589,069,7601 entriesQ6_K
bartowski/gemma-2-9b-it-GGUF7,811,277,7601 entriesQ6_K_L
bartowski/gemma-2-9b-it-GGUF9,827,148,7361 entriesQ8_0
bartowski/gemma-2-9b-it-GGUF10,506,446,7201 entriesF32
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Released
Task

More from Google

Across the range 5 models by family