Instruction Following on Vicuna & WizardLM Urdu
71.1Win Rate (vs ChatGPT)X-Instruction
Evaluation results
| Method | Links | ||
|---|---|---|---|
| X-InstructionParameters=13B, Zero-shot prompting=false2024.05 | 71.1 | 7.5 | |
| X-InstructionParameters=13B, Zero-shot prompting=true2024.05 | 57.7 | 6.7 | |
| X-InstructionParameters=7B, Zero-shot prompting=false2024.05 | 57.4 | 6.4 | |
| X-InstructionParameters=7B, Zero-shot prompting=true2024.05 | 51 | 5.6 | |
| Bactrian-MParameters=13B, Zero-shot prompting=false2024.05 | 51 | 5.2 | |
| Bactrian-MParameters=7B, Zero-shot prompting=false2024.05 | 49 | 5.2 | |
| Alpaca-MTParameters=7B, Zero-shot prompting=false2024.05 | 33.9 | 3.3 | |
| Bactrian-XParameters=13B, Zero-shot prompting=false2024.05 | 5.4 | 0.5 | |
| Bactrian-XParameters=7B, Zero-shot prompting=false2024.05 | 4.7 | 0.4 |