Google
Gemma 3 12B IT
- Weights at 16-bit
- 24 GB
- Weights at 8-bit (Q8_0)
- 13 GB
- Weights at 4-bit (Q4_K_M)
- 7.4 GB
- Smallest card at 4-bit
- Intel Arc A750 · 8 GB
- Parameters
- Layers
- KV heads
- Licence
Specs
- Attention heads
- Downloads (30 days)
- Family
- GGUF downloads
-
repo bytes files quant unsloth/gemma-3-12b-it-GGUF 3,057,668,576 1 entries UD-IQ1_S unsloth/gemma-3-12b-it-GGUF 3,249,207,776 1 entries UD-IQ1_M unsloth/gemma-3-12b-it-GGUF 3,604,238,816 1 entries UD-IQ2_XXS unsloth/gemma-3-12b-it-GGUF 4,366,371,296 1 entries UD-IQ2_M unsloth/gemma-3-12b-it-GGUF 4,768,221,536 1 entries Q2_K unsloth/gemma-3-12b-it-GGUF 4,768,221,536 1 entries Q2_K_L unsloth/gemma-3-12b-it-GGUF 4,834,206,176 1 entries UD-IQ3_XXS unsloth/gemma-3-12b-it-GGUF 4,860,535,136 1 entries UD-Q2_K_XL unsloth/gemma-3-12b-it-GGUF 5,458,315,616 1 entries Q3_K_S unsloth/gemma-3-12b-it-GGUF 6,008,818,016 1 entries Q3_K_M unsloth/gemma-3-12b-it-GGUF 6,142,818,656 1 entries UD-Q3_K_XL unsloth/gemma-3-12b-it-GGUF 6,550,964,576 1 entries IQ4_XS unsloth/gemma-3-12b-it-GGUF 6,887,164,256 1 entries IQ4_NL unsloth/gemma-3-12b-it-GGUF 6,909,282,656 1 entries Q4_0 unsloth/gemma-3-12b-it-GGUF 6,935,333,216 1 entries Q4_K_S unsloth/gemma-3-12b-it-GGUF 7,300,778,336 1 entries Q4_K_M unsloth/gemma-3-12b-it-GGUF 7,432,229,216 1 entries UD-Q4_K_XL unsloth/gemma-3-12b-it-GGUF 7,559,563,616 1 entries Q4_1 unsloth/gemma-3-12b-it-GGUF 8,231,962,976 1 entries Q5_K_S unsloth/gemma-3-12b-it-GGUF 8,445,036,896 1 entries Q5_K_M unsloth/gemma-3-12b-it-GGUF 8,462,578,016 1 entries UD-Q5_K_XL unsloth/gemma-3-12b-it-GGUF 9,660,811,616 1 entries Q6_K unsloth/gemma-3-12b-it-GGUF 10,556,051,936 1 entries UD-Q6_K_XL unsloth/gemma-3-12b-it-GGUF 12,510,212,576 1 entries Q8_0 unsloth/gemma-3-12b-it-GGUF 14,394,193,376 1 entries UD-Q8_K_XL unsloth/gemma-3-12b-it-GGUF 23,540,151,520 1 entries BF16 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Released
- Task