Instruction Following on Vicuna low-resource
0.85Win Rate (bn)X-Instruction
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| X-InstructionModel Parameters=13B2024.05 | 0.85 | 0.65 | 0.788 | |
| X-InstructionModel Parameters=7B2024.05 | 0.613 | 0.6 | 0.6 | |
| Bactrian-MModel Parameters=13B2024.05 | 0.488 | 0.588 | 0.563 | |
| Bactrian-MModel Parameters=7B2024.05 | 0.45 | 0.563 | 0.575 | |
| Alpaca-MTModel Parameters=7B2024.05 | 0.2 | 0.413 | 0.375 | |
| Bactrian-XModel Parameters=7B2024.05 | 0.013 | 0.425 | 0.063 | |
| Bactrian-XModel Parameters=13B2024.05 | 0 | 0.413 | 0.05 |