Instruction Following on Vicuna & WizardLM Indonesian
50.3Win Rate (vs ChatGPT)X-Instruction
Evaluation results
| Method | Links | ||
|---|---|---|---|
| X-InstructionParameters=13B, Zero-shot prompting=false2024.05 | 50.3 | 8.2 | |
| X-InstructionParameters=13B, Zero-shot prompting=true2024.05 | 44 | 7.5 | |
| X-InstructionParameters=7B, Zero-shot prompting=false2024.05 | 41.3 | 7.1 | |
| Bactrian-MParameters=13B, Zero-shot prompting=false2024.05 | 39.6 | 7.5 | |
| Bactrian-MParameters=7B, Zero-shot prompting=false2024.05 | 37.2 | 6.7 | |
| X-InstructionParameters=7B, Zero-shot prompting=true2024.05 | 37.2 | 6.9 | |
| Alpaca-MTParameters=7B, Zero-shot prompting=false2024.05 | 24.5 | 5.4 | |
| Bactrian-XParameters=13B, Zero-shot prompting=false2024.05 | 21.8 | 3.5 | |
| Bactrian-XParameters=7B, Zero-shot prompting=false2024.05 | 19.1 | 2.8 |