Instruction Following on Vicuna & WizardLM Thai
53Win Rate (vs ChatGPT)X-Instruction
Evaluation results
| Method | Links | ||
|---|---|---|---|
| X-InstructionParameters=13B, Zero-shot prompting=false2024.05 | 53 | 7.6 | |
| X-InstructionParameters=13B, Zero-shot prompting=true2024.05 | 43 | 6.1 | |
| Bactrian-MParameters=13B, Zero-shot prompting=false2024.05 | 41.6 | 6 | |
| X-InstructionParameters=7B, Zero-shot prompting=false2024.05 | 40.6 | 5.8 | |
| Bactrian-MParameters=7B, Zero-shot prompting=false2024.05 | 37.6 | 5.4 | |
| X-InstructionParameters=7B, Zero-shot prompting=true2024.05 | 35.2 | 5 | |
| Alpaca-MTParameters=7B, Zero-shot prompting=false2024.05 | 23.5 | 3 | |
| Bactrian-XParameters=13B, Zero-shot prompting=false2024.05 | 3 | 0.4 | |
| Bactrian-XParameters=7B, Zero-shot prompting=false2024.05 | 0.7 | 0.2 |