| AI model | Parameters | Layers | KV heads | Context | Licence |
|---|---|---|---|---|---|
| NousResearch Hermes-3-Llama-3.1-8B | 8.03 B | 32 layers | 8 heads | 131,072 tokens | llama3 |
| NousResearch Llama-2-7b-hf | 6.74 B | 32 layers | 32 heads | 4,096 tokens | – |
| NousResearch Llama-3.2-1B | 1.24 B | 16 layers | 8 heads | 131,072 tokens | llama3.2 |
| NousResearch Meta-Llama-3-8B | 8.03 B | 32 layers | 8 heads | 8,192 tokens | llama3 |
| NousResearch Meta-Llama-3-8B-Instruct | 8.03 B | 32 layers | 8 heads | 8,192 tokens | llama3 |
| NousResearch Meta-Llama-3-70B-Instruct | 70.6 B | 80 layers | 8 heads | 8,192 tokens | llama3 |
| NousResearch Meta-Llama-3.1-8B | 8.03 B | 32 layers | 8 heads | 131,072 tokens | llama3.1 |
| NousResearch Meta-Llama-3.1-8B-Instruct | 8.03 B | 32 layers | 8 heads | 131,072 tokens | llama3.1 |
Other makers
- Qwen (Alibaba Cloud)73
- DeepSeek23
- Meta21
- ibm-granite17
- nvidia15
- Microsoft14
- allenai13
- Google13
- zai-org13
- EleutherAI8
- Mistral AI7
- LiquidAI6
- HuggingFaceTB5
- moonshotai5
- h2oai4
- MiniMaxAI4
- openbmb4
- poolside4
- bigscience3
- internlm3
- LGAI-EXAONE3
- openai-community3
- tencent3
- TinyLlama3
- XiaomiMiMo3
- 01-ai2
- ai21labs2
- bigcode2
- CohereLabs2
- inclusionAI2
- OpenAI2
- PrimeIntellect2
- tiiuae2
- upstage2
- aisingapore1
- baidu1
- BSC-LT1
- ByteDance-Seed1
- codellama1
- facebook1
- Salesforce1
- stepfun-ai1
- swiss-ai1