Compositional multi-tasking on Compositional multi-tasking Reply + tone adj. (test)
14.33W-R ScoreJoint-expert LoRA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Joint-expert LoRAEfficient?=false2025.07 | 14.33 | 47.06 | |
| Learnable Calibration++Efficient?=true2025.07 | 13.54 | 45.4 | |
| Shared Learnable Calibration++Efficient?=true2025.07 | 11.06 | 42.33 | |
| Learnable CalibrationEfficient?=true2025.07 | 10.86 | 44.99 | |
| Shared Learnable CalibrationEfficient?=true2025.07 | 9.23 | 39.61 | |
| Main-task LoRAEfficient?=true2025.07 | 9.12 | 36.25 | |
| LoraHub mergeEfficient?=true2025.07 | 8.69 | 39.07 | |
| Multi-step LoRA usageEfficient?=false2025.07 | 8.09 | 45.78 | |
| DAM/ZipLoRA mergeEfficient?=true2025.07 | 8 | 43.19 | |
| Linear mergeEfficient?=true2025.07 | 7.72 | 41.93 | |
| Concat mergeEfficient?=true2025.07 | 7.65 | 41.77 | |
| LM-Cocktail mergeEfficient?=true2025.07 | 6.67 | 48.76 | |
| Slerp mergeEfficient?=true2025.07 | 6.57 | 46.97 | |
| TIES mergeEfficient?=true2025.07 | 6.47 | 47.87 | |
| In-context learningEfficient?=true2025.07 | 4.66 | 46.23 | |
| Auxiliary-task LoRAEfficient?=true2025.07 | 4.59 | 36.68 | |
| DARE mergeEfficient?=true2025.07 | 4.56 | 41.76 | |
| Zero-shotEfficient?=true2025.07 | 3.53 | 33.66 |