Instruction Following on Vicuna & WizardLM Tamil ta
76.8Win Rate (vs ChatGPT)X-Instruction
Evaluation results
| Method | Links | ||
|---|---|---|---|
| X-InstructionParameters=13B, Zero-shot prompting=false2024.05 | 76.8 | 7.6 | |
| X-InstructionParameters=13B, Zero-shot prompting=true2024.05 | 67.1 | 6.8 | |
| X-InstructionParameters=7B, Zero-shot prompting=true2024.05 | 55.7 | 5.3 | |
| X-InstructionParameters=7B, Zero-shot prompting=false2024.05 | 54.7 | 5.2 | |
| Bactrian-MParameters=13B, Zero-shot prompting=false2024.05 | 28.9 | 2.6 | |
| Alpaca-MTParameters=7B, Zero-shot prompting=false2024.05 | 24.8 | 2.3 | |
| Bactrian-MParameters=7B, Zero-shot prompting=false2024.05 | 22.1 | 1.9 | |
| Bactrian-XParameters=13B, Zero-shot prompting=false2024.05 | 1.7 | 0.2 | |
| Bactrian-XParameters=7B, Zero-shot prompting=false2024.05 | 0.3 | 0 |