Skip to content
IBM Granite

Granite 4.1 3B

Maker’s page
Check price at Amazon for ibm-granite granite-4.1-3b (affiliate link, opens in new tab)
Weights at 16-bit
6.8 GB
Weights at 8-bit (Q8_0)
3.6 GB
Weights at 4-bit (Q4_K_M)
2.1 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
GGUF downloads
repobytesfilesquant
ibm-granite/granite-4.1-3b-GGUF1,371,437,6641 entriesQ2_K
ibm-granite/granite-4.1-3b-GGUF1,566,816,8641 entriesQ3_K_S
ibm-granite/granite-4.1-3b-GGUF1,725,577,8241 entriesQ3_K_M
ibm-granite/granite-4.1-3b-GGUF1,864,186,4641 entriesQ3_K_L
ibm-granite/granite-4.1-3b-GGUF1,984,608,8641 entriesQ4_0
ibm-granite/granite-4.1-3b-GGUF1,998,371,4241 entriesQ4_K_S
ibm-granite/granite-4.1-3b-GGUF2,099,501,6641 entriesQ4_K_M
ibm-granite/granite-4.1-3b-GGUF2,181,216,8641 entriesQ4_1
ibm-granite/granite-4.1-3b-GGUF2,377,824,8641 entriesQ5_0
ibm-granite/granite-4.1-3b-GGUF2,377,824,8641 entriesQ5_K_S
ibm-granite/granite-4.1-3b-GGUF2,437,012,0641 entriesQ5_K_M
ibm-granite/granite-4.1-3b-GGUF2,574,432,8641 entriesQ5_1
ibm-granite/granite-4.1-3b-GGUF2,795,616,8641 entriesQ6_K
ibm-granite/granite-4.1-3b-GGUF3,619,691,1041 entriesQ8_0
ibm-granite/granite-4.1-3b-GGUF6,809,655,9041 entriesBF16
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Task

More from ibm-granite