H2oai
H2ogpt 4096 Llama2 70B Chat
Check price at Amazon for h2oai h2ogpt-4096-llama2-70b-chat (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 138 GB
- Weights at 8-bit (Q8_0)
- 73 GB
- Weights at 4-bit (Q4_K_M)
- 42 GB
- Smallest card at 4-bit
- RTX 6000 Ada Generation · 48 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Task