Instruction Following on Wizard, Dolly-15k, and Alpaca
30.33Wizard ScoreFSLoRA
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| FSLoRABackbone=LLaMA-7B2025.01 | 30.33 | 40.79 | 30.68 | 33.93 | |
| FlexLoRABackbone=LLaMA-7B2025.01 | 28.25 | 35.6 | 30.4 | 31.42 | |
| FLoRABackbone=LLaMA-7B2025.01 | 27.91 | 28.5 | 29.54 | 28.65 | |
| HeteroLoRABackbone=LLaMA-7B2025.01 | 27.15 | 26.7 | 28.74 | 27.53 |