Parameter-Efficient Fine-Tuning on 11 PEFT Tasks (test)
73.1Avg AccuracyMultitask
Evaluation Results
| Method | Links | |
|---|---|---|
| MultitaskMethodology=(IA)³2025.05 | 73.1 | |
| Fine-tunedMethodology=(IA)³2025.05 | 71.4 | |
| NPSMethodology=(IA)³2025.05 | 68.2 | |
| Ties-MergingMethodology=(IA)³2025.05 | 66.8 | |
| Consensus TIESMethodology=(IA)³2025.05 | 66.6 | |
| Consensus TAMethodology=(IA)³2025.05 | 65.8 | |
| Task ArithmeticMethodology=(IA)³2025.05 | 63.9 | |
| Fisher MergingMethodology=(IA)³2025.05 | 62.2 | |
| RegMeanMethodology=(IA)³2025.05 | 58 | |
| AveragingMethodology=(IA)³2025.05 | 57.9 |