Instruction Following on INSTRUCTEVAL (test)
47.3MMLUFT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| FT#Params=7B, Training Status=Full Fine-tuning2024.02 | 47.3 | 29.12 | 12.8 | 32.72 | |
| MELORA#Params=0.5M2024.02 | 46.46 | 32.65 | 16.16 | 33.01 | |
| w/o FTTraining Status=Zero-shot / No Fine-tuning2024.02 | 45.96 | 31.55 | 12.2 | 32.04 | |
| AdaLoRA#Params=33.6M2024.02 | 45.96 | 31.94 | 14.02 | 32.85 | |
| LoRA#Params=33.6M2024.02 | 45.64 | 32.46 | 15.09 | 32.4 | |
| QLoRA#Params=33.6M2024.02 | 45.4 | 28.97 | 15.24 | 32.81 |