Instruction Following on IFEval (IFEVAL, GM)
36.13IFEVAL ScoreFoLoRA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FoLoRA#Param=320M, Base Model=LLaMA-2-7B, Fine-tuning Dataset=WizardLM-Evol-Instruct, Evaluation Seeds=32026.05 | 36.13 | 29.26 | |
| CorDA#Param=320M, Base Model=LLaMA-2-7B, Fine-tuning Dataset=WizardLM-Evol-Instruct, Evaluation Seeds=32026.05 | 34.45 | 27.76 | |
| LoRA-Null#Param=320M, Base Model=LLaMA-2-7B, Fine-tuning Dataset=WizardLM-Evol-Instruct, Evaluation Seeds=32026.05 | 32.61 | 27.42 | |
| LoRA#Param=320M, Base Model=LLaMA-2-7B, Fine-tuning Dataset=WizardLM-Evol-Instruct, Evaluation Seeds=32026.05 | 32.49 | 24.8 | |
| MiLoRA#Param=320M, Base Model=LLaMA-2-7B, Fine-tuning Dataset=WizardLM-Evol-Instruct, Evaluation Seeds=32026.05 | 32.21 | 26.34 | |
| OPLoRA#Param=320M, Base Model=LLaMA-2-7B, Fine-tuning Dataset=WizardLM-Evol-Instruct, Evaluation Seeds=32026.05 | 28.65 | 24.75 |