Skip to content
IBM Granite

Granite 3.1 3B A800M Instruct

Maker’s page
Check price at Amazon for ibm-granite granite-3.1-3b-a800m-instruct (affiliate link, opens in new tab)
Weights at 16-bit
6.6 GB
Weights at 8-bit (Q8_0)
3.5 GB
Weights at 4-bit (Q4_K_M)
2.0 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
Experts
Experts per token
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Task

More from ibm-granite