Summarization + Tone Adjustment on Compositional Multi-tasking (test)
36.09ROUGE-1 ScoreLearnable Calibration++
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Learnable Calibration++Parameter Sharing=Separate2025.07 | 36.09 | 10.95 | 26.96 | |
| Learnable CalibrationParameter Sharing=Separate2025.07 | 33.14 | 9.48 | 24.58 | |
| Learnable Calibration++Parameter Sharing=Shared2025.07 | 29.89 | 8.38 | 22.68 | |
| Learnable CalibrationParameter Sharing=Shared2025.07 | 28 | 7.72 | 20.98 | |
| Multi-step LoRA usage2025.07 | 27.19 | 6.85 | 20.23 | |
| Joint-expert LoRA2025.07 | 24.98 | 6.38 | 19.08 | |
| In-context learning2025.07 | 23.53 | 5.68 | 16.96 | |
| Main-task LoRA2025.07 | 21.53 | 4.43 | 16.43 | |
| LoraHub merge2025.07 | 20.94 | 4.32 | 16.13 | |
| DAM/ZipLoRA merge2025.07 | 20.36 | — | 15.68 | |
| TIES merge2025.07 | 20.03 | 3.88 | 14.95 | |
| Concat merge2025.07 | 19.87 | 3.94 | 15.27 | |
| Linear merge2025.07 | 19.84 | 3.93 | 15.26 | |
| LM-Cocktail merge2025.07 | 19.78 | 3.81 | 14.88 | |
| Slerp merge2025.07 | 19.68 | 3.81 | 14.87 | |
| DARE merge2025.07 | 19.5 | 3.69 | 14.51 | |
| Zero-shot2025.07 | 18.84 | 3.42 | 13.93 | |
| Auxiliary-task LoRA2025.07 | 18.61 | 3.71 | 14.33 |