Diverse Language Understanding on 62 downstream tasks
67.5Average AccuracyOurs
Evaluation results
| Method | Links | |
|---|---|---|
| OursLoRA pool size=30, Target-task LoRA included=true2026.02 | 67.5 | |
| AdaMergingLoRA pool size=30, Target-task LoRA included=true2026.02 | 66.9 | |
| π-TuningLoRA pool size=20, Target-task LoRA included=false2026.02 | 66.8 | |
| π-TuningLoRA pool size=20, Target-task LoRA included=true2026.02 | 66.8 | |
| LoraHubLoRA pool size=30, Target-task LoRA included=true2026.02 | 66.3 | |
| LoRATraining=Trained on target-task data2026.02 | 65.7 | |
| AdaMergingLoRA pool size=30, Target-task LoRA included=false2026.02 | 65.2 | |
| OursLoRA pool size=30, Target-task LoRA included=false2026.02 | 65.2 | |
| LoraHubLoRA pool size=30, Target-task LoRA included=false2026.02 | 56.3 | |
| Simple avg.LoRA pool size=30, Target-task LoRA included=true2026.02 | 53.6 | |
| TSVLoRA pool size=30, Target-task LoRA included=true2026.02 | 52.2 | |
| Simple avg.LoRA pool size=30, Target-task LoRA included=false2026.02 | 49.6 | |
| Simple avg.LoRA pool size=all, Target-task LoRA included=true2026.02 | 49.6 | |
| Simple avg.LoRA pool size=all, Target-task LoRA included=false2026.02 | 49.5 | |
| TSVLoRA pool size=30, Target-task LoRA included=false2026.02 | 48.8 | |
| TIESLoRA pool size=30, Target-task LoRA included=false2026.02 | 46.7 | |
| Promptingprotocol=zero-shot2026.02 | 46.7 | |
| TIESLoRA pool size=30, Target-task LoRA included=true2026.02 | 46.6 |