Table 1 Open-source LLMs used for fine-tuning.
LLM name | Type | Size | LLM version |
|---|---|---|---|
Yi | Open-Source | 34-Billiant | 01-ai/Yi-34B-Chat |
InternLM2 | Open-Source | 20-Billiant | internlm/internlm2-chat-20b |
Mixtral | Open-Source | 46.7-Billiant | mistralai/Mixtral-8 × 7B-Instruct-v0.1 |