Skip to content
Mistral AI

Mistral 7B v0.1

Maker’s page
Check price at Amazon for Mistral AI Mistral-7B-v0.1 (affiliate link, opens in new tab)
Weights at 16-bit
14 GB
Weights at 8-bit (Q8_0)
7.7 GB
Weights at 4-bit (Q4_K_M)
4.4 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
GGUF downloads
repobytesfilesquant
TheBloke/Mistral-7B-v0.1-GGUF3,083,097,7281 entriesQ2_K
TheBloke/Mistral-7B-v0.1-GGUF3,164,567,1681 entriesQ3_K_S
TheBloke/Mistral-7B-v0.1-GGUF3,518,985,8561 entriesQ3_K_M
TheBloke/Mistral-7B-v0.1-GGUF3,822,024,3201 entriesQ3_K_L
TheBloke/Mistral-7B-v0.1-GGUF4,108,916,3521 entriesQ4_0
TheBloke/Mistral-7B-v0.1-GGUF4,140,373,6321 entriesQ4_K_S
TheBloke/Mistral-7B-v0.1-GGUF4,368,438,9121 entriesQ4_K_M
TheBloke/Mistral-7B-v0.1-GGUF4,997,715,5841 entriesQ5_0
TheBloke/Mistral-7B-v0.1-GGUF4,997,715,5841 entriesQ5_K_S
TheBloke/Mistral-7B-v0.1-GGUF5,131,409,0241 entriesQ5_K_M
TheBloke/Mistral-7B-v0.1-GGUF5,942,064,7681 entriesQ6_K
TheBloke/Mistral-7B-v0.1-GGUF7,695,857,2801 entriesQ8_0
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Sliding window
Task

More from Mistral AI