Google
Gemma 2 27B IT
- Weights at 16-bit
- 54 GB
- Weights at 8-bit (Q8_0)
- 29 GB
- Weights at 4-bit (Q4_K_M)
- 17 GB
- Smallest card at 4-bit
- RTX 4000 Ada Generation · 20 GB
- Parameters
- Layers
- KV heads
- Licence
Specs
- Attention heads
- Downloads (30 days)
- Family
- GGUF downloads
-
repo bytes files quant bartowski/gemma-2-27b-it-GGUF 8,399,716,832 1 entries IQ2_XS bartowski/gemma-2-27b-it-GGUF 8,652,161,504 1 entries IQ2_S bartowski/gemma-2-27b-it-GGUF 9,398,877,696 1 entries IQ2_M bartowski/gemma-2-27b-it-GGUF 10,449,575,424 1 entries Q2_K bartowski/gemma-2-27b-it-GGUF 10,735,271,424 1 entries Q2_K_L bartowski/gemma-2-27b-it-GGUF 10,750,754,304 1 entries IQ3_XXS bartowski/gemma-2-27b-it-GGUF 11,550,629,376 1 entries IQ3_XS bartowski/gemma-2-27b-it-GGUF 12,169,059,840 1 entries Q3_K_S bartowski/gemma-2-27b-it-GGUF 12,454,829,568 1 entries IQ3_M bartowski/gemma-2-27b-it-GGUF 13,424,647,680 1 entries Q3_K_M bartowski/gemma-2-27b-it-GGUF 14,519,361,024 1 entries Q3_K_L bartowski/gemma-2-27b-it-GGUF 14,805,057,024 1 entries Q3_K_XL bartowski/gemma-2-27b-it-GGUF 14,814,420,480 1 entries IQ4_XS bartowski/gemma-2-27b-it-GGUF 15,739,264,512 1 entries Q4_K_S bartowski/gemma-2-27b-it-GGUF 16,645,381,632 1 entries Q4_K_M bartowski/gemma-2-27b-it-GGUF 16,931,077,632 1 entries Q4_K_L bartowski/gemma-2-27b-it-GGUF 18,884,206,080 1 entries Q5_K_S bartowski/gemma-2-27b-it-GGUF 19,408,117,248 1 entries Q5_K_M bartowski/gemma-2-27b-it-GGUF 19,693,813,248 1 entries Q5_K_L bartowski/gemma-2-27b-it-GGUF 22,343,523,840 1 entries Q6_K bartowski/gemma-2-27b-it-GGUF 22,629,219,840 1 entries Q6_K_L bartowski/gemma-2-27b-it-GGUF 28,937,387,520 1 entries Q8_0 bartowski/gemma-2-27b-it-GGUF 108,914,573,888 3 entries F32 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Released
- Task