Google
Gemma 2 9B IT
- Weights at 16-bit
- 18 GB
- Weights at 8-bit (Q8_0)
- 9.8 GB
- Weights at 4-bit (Q4_K_M)
- 5.6 GB
- Smallest card at 4-bit
- Intel Arc A380 · 6 GB
- Parameters
- Layers
- KV heads
- Licence
Specs
- Attention heads
- Downloads (30 days)
- Family
- GGUF downloads
-
repo bytes files quant bartowski/gemma-2-9b-it-GGUF 3,067,381,632 1 entries IQ2_XS bartowski/gemma-2-9b-it-GGUF 3,211,487,104 1 entries IQ2_S bartowski/gemma-2-9b-it-GGUF 3,434,668,992 1 entries IQ2_M bartowski/gemma-2-9b-it-GGUF 3,796,739,008 1 entries IQ3_XXS bartowski/gemma-2-9b-it-GGUF 3,805,397,952 1 entries Q2_K bartowski/gemma-2-9b-it-GGUF 4,027,605,952 1 entries Q2_K_L bartowski/gemma-2-9b-it-GGUF 4,144,989,120 1 entries IQ3_XS bartowski/gemma-2-9b-it-GGUF 4,337,664,960 1 entries Q3_K_S bartowski/gemma-2-9b-it-GGUF 4,494,615,488 1 entries IQ3_M bartowski/gemma-2-9b-it-GGUF 4,761,781,184 1 entries Q3_K_M bartowski/gemma-2-9b-it-GGUF 5,132,452,800 1 entries Q3_K_L bartowski/gemma-2-9b-it-GGUF 5,183,030,208 1 entries IQ4_XS bartowski/gemma-2-9b-it-GGUF 5,354,660,768 1 entries Q3_K_XL bartowski/gemma-2-9b-it-GGUF 5,478,925,248 1 entries Q4_K_S bartowski/gemma-2-9b-it-GGUF 5,761,057,728 1 entries Q4_K_M bartowski/gemma-2-9b-it-GGUF 5,983,265,728 1 entries Q4_K_L bartowski/gemma-2-9b-it-GGUF 6,483,592,128 1 entries Q5_K_S bartowski/gemma-2-9b-it-GGUF 6,647,366,592 1 entries Q5_K_M bartowski/gemma-2-9b-it-GGUF 6,843,425,696 1 entries F16 bartowski/gemma-2-9b-it-GGUF 6,869,574,592 1 entries Q5_K_L bartowski/gemma-2-9b-it-GGUF 7,589,069,760 1 entries Q6_K bartowski/gemma-2-9b-it-GGUF 7,811,277,760 1 entries Q6_K_L bartowski/gemma-2-9b-it-GGUF 9,827,148,736 1 entries Q8_0 bartowski/gemma-2-9b-it-GGUF 10,506,446,720 1 entries F32 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Released
- Task