Instruction Following on Vicuna & WizardLM Swahili
54.4Win Rate (vs ChatGPT)X-Instruction
Evaluation results
| Method | Links | ||
|---|---|---|---|
| X-InstructionParameters=13B, Zero-shot prompting=false2024.05 | 54.4 | 7.1 | |
| X-InstructionParameters=7B, Zero-shot prompting=false2024.05 | 54 | 7 | |
| Bactrian-MParameters=13B, Zero-shot prompting=false2024.05 | 50 | 6.7 | |
| X-InstructionParameters=13B, Zero-shot prompting=true2024.05 | 49.3 | 6.6 | |
| Bactrian-MParameters=7B, Zero-shot prompting=false2024.05 | 46.3 | 6.1 | |
| X-InstructionParameters=7B, Zero-shot prompting=true2024.05 | 41.9 | 6 | |
| Bactrian-XParameters=13B, Zero-shot prompting=false2024.05 | 29.5 | 3.6 | |
| Alpaca-MTParameters=7B, Zero-shot prompting=false2024.05 | 27.5 | 3.1 | |
| Bactrian-XParameters=7B, Zero-shot prompting=false2024.05 | 27.2 | 2.8 |