Openbmb
MiniCPM5 2B
- Weights at 16-bit
- 5.0 GB
- Weights at 8-bit (Q8_0)
- 2.7 GB
- Weights at 4-bit (Q4_K_M)
- 1.5 GB
- Smallest card at 4-bit
- Intel Arc A380 · 6 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- GGUF downloads
-
repo bytes files quant bartowski/MiniCPM5-2B-GGUF 969,755,872 1 entries IQ2_M bartowski/MiniCPM5-2B-GGUF 1,014,320,352 1 entries Q2_K bartowski/MiniCPM5-2B-GGUF 1,143,844,064 1 entries IQ3_XXS bartowski/MiniCPM5-2B-GGUF 1,189,694,688 1 entries Q3_K_S bartowski/MiniCPM5-2B-GGUF 1,193,749,728 1 entries IQ3_XS bartowski/MiniCPM5-2B-GGUF 1,236,085,984 1 entries Q3_K_M bartowski/MiniCPM5-2B-GGUF 1,287,011,552 1 entries Q3_K_L bartowski/MiniCPM5-2B-GGUF 1,362,734,304 1 entries IQ3_M bartowski/MiniCPM5-2B-GGUF 1,463,942,368 1 entries IQ4_XS bartowski/MiniCPM5-2B-GGUF 1,516,997,856 1 entries Q4_0 bartowski/MiniCPM5-2B-GGUF 1,534,004,448 1 entries Q4_K_S bartowski/MiniCPM5-2B-GGUF 1,605,668,064 1 entries IQ4_NL bartowski/MiniCPM5-2B-GGUF 1,615,826,144 1 entries Q4_K_M bartowski/MiniCPM5-2B-GGUF 1,648,135,392 1 entries Q4_1 bartowski/MiniCPM5-2B-GGUF 1,714,719,968 1 entries Q4_K_L bartowski/MiniCPM5-2B-GGUF 1,816,530,144 1 entries Q5_K_S bartowski/MiniCPM5-2B-GGUF 1,920,175,328 1 entries Q5_K_M bartowski/MiniCPM5-2B-GGUF 2,107,305,184 1 entries Q6_K bartowski/MiniCPM5-2B-GGUF 2,278,976,736 1 entries Q6_K_L bartowski/MiniCPM5-2B-GGUF 2,679,712,992 1 entries Q8_0 bartowski/MiniCPM5-2B-GGUF 5,039,008,704 1 entries BF16 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Task