Instruction Following on Vicuna & WizardLM Bengali bn
68.8Win Rate (vs ChatGPT)X-Instruction
Evaluation results
| Method | Links | ||
|---|---|---|---|
| X-InstructionParameters=13B, Zero-shot prompting=false2024.05 | 68.8 | 7.4 | |
| X-InstructionParameters=13B, Zero-shot prompting=true2024.05 | 58.4 | 6.7 | |
| X-InstructionParameters=7B, Zero-shot prompting=false2024.05 | 41.3 | 4.9 | |
| Bactrian-MParameters=13B, Zero-shot prompting=false2024.05 | 38.6 | 4.4 | |
| X-InstructionParameters=7B, Zero-shot prompting=true2024.05 | 35.2 | 4.2 | |
| Bactrian-MParameters=7B, Zero-shot prompting=false2024.05 | 34.2 | 3.7 | |
| Alpaca-MTParameters=7B, Zero-shot prompting=false2024.05 | 20.5 | 2.5 | |
| Bactrian-XParameters=7B, Zero-shot prompting=false2024.05 | 1.7 | 0.2 | |
| Bactrian-XParameters=13B, Zero-shot prompting=false2024.05 | 1 | 0.2 |