Skip to content
Google

Gemma 3 4B IT

Maker’s page
Check price at Amazon for Google Gemma 3 4B IT (affiliate link, opens in new tab)
Weights at 16-bit
8.6 GB
Weights at 8-bit (Q8_0)
4.6 GB
Weights at 4-bit (Q4_K_M)
2.6 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB
Parameters
Layers
KV heads
Licence

Specs

Attention heads
Downloads (30 days)
Family
GGUF downloads
repobytesfilesquant
unsloth/gemma-3-4b-it-GGUF1,179,910,0161 entriesUD-IQ1_S
unsloth/gemma-3-4b-it-GGUF1,239,711,6161 entriesUD-IQ1_M
unsloth/gemma-3-4b-it-GGUF1,342,275,4561 entriesUD-IQ2_XXS
unsloth/gemma-3-4b-it-GGUF1,565,015,9361 entriesUD-IQ2_M
unsloth/gemma-3-4b-it-GGUF1,710,751,6161 entriesUD-IQ3_XXS
unsloth/gemma-3-4b-it-GGUF1,729,164,4161 entriesQ2_K
unsloth/gemma-3-4b-it-GGUF1,729,164,4161 entriesQ2_K_L
unsloth/gemma-3-4b-it-GGUF1,769,407,6161 entriesUD-Q2_K_XL
unsloth/gemma-3-4b-it-GGUF1,937,364,0961 entriesQ3_K_S
unsloth/gemma-3-4b-it-GGUF2,098,459,7761 entriesQ3_K_M
unsloth/gemma-3-4b-it-GGUF2,150,929,5361 entriesUD-Q3_K_XL
unsloth/gemma-3-4b-it-GGUF2,263,241,8561 entriesIQ4_XS
unsloth/gemma-3-4b-it-GGUF2,363,511,9361 entriesIQ4_NL
unsloth/gemma-3-4b-it-GGUF2,370,065,5361 entriesQ4_0
unsloth/gemma-3-4b-it-GGUF2,377,929,8561 entriesQ4_K_S
unsloth/gemma-3-4b-it-GGUF2,489,894,0161 entriesQ4_K_M
unsloth/gemma-3-4b-it-GGUF2,544,288,8961 entriesUD-Q4_K_XL
unsloth/gemma-3-4b-it-GGUF2,564,052,0961 entriesQ4_1
unsloth/gemma-3-4b-it-GGUF2,764,592,2561 entriesQ5_K_S
unsloth/gemma-3-4b-it-GGUF2,829,698,1761 entriesQ5_K_M
unsloth/gemma-3-4b-it-GGUF2,836,231,2961 entriesUD-Q5_K_XL
unsloth/gemma-3-4b-it-GGUF3,190,740,0961 entriesQ6_K
unsloth/gemma-3-4b-it-GGUF3,566,628,7361 entriesUD-Q6_K_XL
unsloth/gemma-3-4b-it-GGUF4,130,402,1761 entriesQ8_0
unsloth/gemma-3-4b-it-GGUF5,165,205,3761 entriesUD-Q8_K_XL
unsloth/gemma-3-4b-it-GGUF7,767,803,5201 entriesBF16
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Released
Task

More from Google

Across the range 5 models by family