Instruction Following on Vicuna & WizardLM Turkish
53.7Win Rate (vs ChatGPT)X-Instruction
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| X-InstructionParameters=13B, Zero-shot prompting=false2024.05 | 53.7 | 7 | |
| X-InstructionParameters=13B, Zero-shot prompting=true2024.05 | 53.4 | 6.5 | |
| Bactrian-MParameters=7B, Zero-shot prompting=false2024.05 | 52 | 6.7 | |
| X-InstructionParameters=7B, Zero-shot prompting=false2024.05 | 49.7 | 6 | |
| Bactrian-MParameters=13B, Zero-shot prompting=false2024.05 | 49 | 6.8 | |
| X-InstructionParameters=7B, Zero-shot prompting=true2024.05 | 47 | 5.9 | |
| Alpaca-MTParameters=7B, Zero-shot prompting=false2024.05 | 34.6 | 3.3 | |
| Bactrian-XParameters=13B, Zero-shot prompting=false2024.05 | 25.5 | 1.9 | |
| Bactrian-XParameters=7B, Zero-shot prompting=false2024.05 | 18.8 | 1.3 |