Adapter Merging on MERGE-PEFT (test)
100Math ScoreSingle-task (no merge)
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Single-task (no merge)2026.06 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | |
| Oracle routercost-blind=true2026.06 | 99.1 | 98.7 | 99.2 | 99.4 | 98.9 | 99.1 | 98.7 | |
| MergeProbe2026.06 | 92.4 | 89.1 | 93 | 93.6 | 88.7 | 91.4 | 88.7 | |
| FlyLoRA2026.06 | 88.1 | 83.6 | 89.7 | 90.2 | 81.9 | 86.7 | 81.9 | |
| OSRM2026.06 | 85.7 | 80.4 | 87.9 | 88.3 | 77.6 | 84 | 77.6 | |
| LoRA-LEGO2026.06 | 83.5 | 77.9 | 86.1 | 87 | 74.2 | 81.7 | 74.2 | |
| Fisher merging2026.06 | 80.2 | 73.1 | 84.6 | 85.2 | 69.8 | 78.6 | 69.8 | |
| TIES-merging2026.06 | 78.9 | 71.6 | 83.2 | 84 | 67.5 | 77 | 67.5 | |
| Direct averaging2026.06 | 71.4 | 64.2 | 78.5 | 80.1 | 58.3 | 70.5 | 58.3 |