Instruction Following on Vicuna & WizardLM Average
59.7Win Rate vs ChatGPTX-Instruction
Evaluation results
| Method | Links | ||
|---|---|---|---|
| X-InstructionParameters=13B, Zero-shot prompting=false2024.05 | 59.7 | 7.5 | |
| X-InstructionParameters=13B, Zero-shot prompting=true2024.05 | 53.6 | 6.8 | |
| X-InstructionParameters=7B, Zero-shot prompting=false2024.05 | 49.2 | 6.3 | |
| Bactrian-MParameters=13B, Zero-shot prompting=false2024.05 | 44.6 | 5.9 | |
| X-InstructionParameters=7B, Zero-shot prompting=true2024.05 | 43.9 | 5.7 | |
| Bactrian-MParameters=7B, Zero-shot prompting=false2024.05 | 41.2 | 5.3 | |
| Alpaca-MTParameters=7B, Zero-shot prompting=false2024.05 | 27.5 | 3.5 | |
| Bactrian-XParameters=13B, Zero-shot prompting=false2024.05 | 11.3 | 1.5 | |
| Bactrian-XParameters=7B, Zero-shot prompting=false2024.05 | 9.3 | 1.1 |