Google
Gemma 3 4B IT
- Weights at 16-bit
- 8.6 GB
- Weights at 8-bit (Q8_0)
- 4.6 GB
- Weights at 4-bit (Q4_K_M)
- 2.6 GB
- Smallest card at 4-bit
- Intel Arc A380 · 6 GB
- Parameters
- Layers
- KV heads
- Licence
Specs
- Attention heads
- Downloads (30 days)
- Family
- GGUF downloads
-
repo bytes files quant unsloth/gemma-3-4b-it-GGUF 1,179,910,016 1 entries UD-IQ1_S unsloth/gemma-3-4b-it-GGUF 1,239,711,616 1 entries UD-IQ1_M unsloth/gemma-3-4b-it-GGUF 1,342,275,456 1 entries UD-IQ2_XXS unsloth/gemma-3-4b-it-GGUF 1,565,015,936 1 entries UD-IQ2_M unsloth/gemma-3-4b-it-GGUF 1,710,751,616 1 entries UD-IQ3_XXS unsloth/gemma-3-4b-it-GGUF 1,729,164,416 1 entries Q2_K unsloth/gemma-3-4b-it-GGUF 1,729,164,416 1 entries Q2_K_L unsloth/gemma-3-4b-it-GGUF 1,769,407,616 1 entries UD-Q2_K_XL unsloth/gemma-3-4b-it-GGUF 1,937,364,096 1 entries Q3_K_S unsloth/gemma-3-4b-it-GGUF 2,098,459,776 1 entries Q3_K_M unsloth/gemma-3-4b-it-GGUF 2,150,929,536 1 entries UD-Q3_K_XL unsloth/gemma-3-4b-it-GGUF 2,263,241,856 1 entries IQ4_XS unsloth/gemma-3-4b-it-GGUF 2,363,511,936 1 entries IQ4_NL unsloth/gemma-3-4b-it-GGUF 2,370,065,536 1 entries Q4_0 unsloth/gemma-3-4b-it-GGUF 2,377,929,856 1 entries Q4_K_S unsloth/gemma-3-4b-it-GGUF 2,489,894,016 1 entries Q4_K_M unsloth/gemma-3-4b-it-GGUF 2,544,288,896 1 entries UD-Q4_K_XL unsloth/gemma-3-4b-it-GGUF 2,564,052,096 1 entries Q4_1 unsloth/gemma-3-4b-it-GGUF 2,764,592,256 1 entries Q5_K_S unsloth/gemma-3-4b-it-GGUF 2,829,698,176 1 entries Q5_K_M unsloth/gemma-3-4b-it-GGUF 2,836,231,296 1 entries UD-Q5_K_XL unsloth/gemma-3-4b-it-GGUF 3,190,740,096 1 entries Q6_K unsloth/gemma-3-4b-it-GGUF 3,566,628,736 1 entries UD-Q6_K_XL unsloth/gemma-3-4b-it-GGUF 4,130,402,176 1 entries Q8_0 unsloth/gemma-3-4b-it-GGUF 5,165,205,376 1 entries UD-Q8_K_XL unsloth/gemma-3-4b-it-GGUF 7,767,803,520 1 entries BF16 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Released
- Task