Skip to content
Swiss Ai

Apertus 8B Instruct 2509

Maker’s page
Check price at Amazon for swiss-ai Apertus-8B-Instruct-2509 (affiliate link, opens in new tab)
Weights at 16-bit
16 GB
Weights at 8-bit (Q8_0)
8.6 GB
Weights at 4-bit (Q4_K_M)
4.9 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
GGUF downloads
repobytesfilesquant
unsloth/Apertus-8B-Instruct-2509-GGUF2,230,400,2561 entriesUD-IQ1_S
unsloth/Apertus-8B-Instruct-2509-GGUF2,348,758,2721 entriesUD-IQ1_M
unsloth/Apertus-8B-Instruct-2509-GGUF2,552,247,5521 entriesUD-IQ2_XXS
unsloth/Apertus-8B-Instruct-2509-GGUF3,026,105,6001 entriesUD-IQ2_M
unsloth/Apertus-8B-Instruct-2509-GGUF3,287,889,1521 entriesQ2_K
unsloth/Apertus-8B-Instruct-2509-GGUF3,356,538,1121 entriesUD-IQ3_XXS
unsloth/Apertus-8B-Instruct-2509-GGUF3,413,718,2721 entriesQ2_K_L
unsloth/Apertus-8B-Instruct-2509-GGUF3,501,372,6721 entriesUD-Q2_K_XL
unsloth/Apertus-8B-Instruct-2509-GGUF3,679,008,0001 entriesQ3_K_S
unsloth/Apertus-8B-Instruct-2509-GGUF4,165,547,2641 entriesQ3_K_M
unsloth/Apertus-8B-Instruct-2509-GGUF4,347,770,1121 entriesUD-Q3_K_XL
unsloth/Apertus-8B-Instruct-2509-GGUF4,480,120,0641 entriesIQ4_XS
unsloth/Apertus-8B-Instruct-2509-GGUF4,694,029,5681 entriesIQ4_NL
unsloth/Apertus-8B-Instruct-2509-GGUF4,699,272,4481 entriesQ4_0
unsloth/Apertus-8B-Instruct-2509-GGUF4,723,389,6961 entriesQ4_K_S
unsloth/Apertus-8B-Instruct-2509-GGUF5,057,885,4401 entriesQ4_K_M
unsloth/Apertus-8B-Instruct-2509-GGUF5,135,938,8161 entriesUD-Q4_K_XL
unsloth/Apertus-8B-Instruct-2509-GGUF5,147,014,4001 entriesQ4_1
unsloth/Apertus-8B-Instruct-2509-GGUF5,616,776,4481 entriesQ5_K_S
unsloth/Apertus-8B-Instruct-2509-GGUF5,812,860,1601 entriesQ5_K_M
unsloth/Apertus-8B-Instruct-2509-GGUF5,823,968,5121 entriesUD-Q5_K_XL
unsloth/Apertus-8B-Instruct-2509-GGUF6,615,020,8001 entriesQ6_K
unsloth/Apertus-8B-Instruct-2509-GGUF7,390,082,3041 entriesUD-Q6_K_XL
unsloth/Apertus-8B-Instruct-2509-GGUF8,565,372,1601 entriesQ8_0
unsloth/Apertus-8B-Instruct-2509-GGUF10,621,891,8401 entriesUD-Q8_K_XL
unsloth/Apertus-8B-Instruct-2509-GGUF16,115,119,0721 entriesBF16
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Task