Compositional multi-tasking Reply + translation (test)
14.99W-R ScoreJoint-expert LoRA
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Joint-expert LoRAEfficient?=false2025.07 | 14.99 | 65.73 | |
| Learnable Calibration++Efficient?=true2025.07 | 12.14 | 63.81 | |
| Multi-step LoRA usageEfficient?=false2025.07 | 10.04 | 69.83 | |
| Shared Learnable Calibration++Efficient?=true2025.07 | 9.99 | 56.74 | |
| Learnable CalibrationEfficient?=true2025.07 | 8.85 | 57.46 | |
| Shared Learnable CalibrationEfficient?=true2025.07 | 6.63 | 49.23 | |
| DAM/ZipLoRA mergeEfficient?=true2025.07 | 4.62 | 31.88 | |
| Auxiliary-task LoRAEfficient?=true2025.07 | 4.03 | 4.73 | |
| Concat mergeEfficient?=true2025.07 | 3.97 | 13.1 | |
| Linear mergeEfficient?=true2025.07 | 3.94 | 12.81 | |
| In-context learningEfficient?=true2025.07 | 3.93 | 8.72 | |
| Slerp mergeEfficient?=true2025.07 | 3.73 | 9.04 | |
| TIES mergeEfficient?=true2025.07 | 3.53 | 8.3 | |
| LoraHub mergeEfficient?=true2025.07 | 3.26 | 12.69 | |
| LM-Cocktail mergeEfficient?=true2025.07 | 3.24 | 7.93 | |
| DARE mergeEfficient?=true2025.07 | 2.95 | 8.57 | |
| Zero-shotEfficient?=true2025.07 | 2.03 | 4.11 | |
| Main-task LoRAEfficient?=true2025.07 | 1.25 | 7.17 |