Multi-task Model Merging on 20 Vision Tasks
94.7Average Absolute AccuracyFine-tuned
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Fine-tunedBackbone=ViT-L/142026.06 | 94.7 | — | |
| Fine-tunedBackbone=ViT-B/162026.06 | 93.2 | — | |
| ESM++Backbone=ViT-L/14, Merging Category=Dynamic Merging, Rank (r)=322026.06 | 93.1 | 98.2 | |
| Fine-tunedBackbone=ViT-B/322026.06 | 91.3 | — | |
| ESMBackbone=ViT-L/14, Merging Category=Static Merging2026.06 | 90.7 | 95.7 | |
| PACT-Iso-CBackbone=ViT-L/142026.06 | 90.3 | 95 | |
| Iso-CTSBackbone=ViT-L/142026.06 | 90.1 | 94.9 | |
| PACT-TSV-MBackbone=ViT-L/142026.06 | 89.7 | 94.3 | |
| TSV-MBackbone=ViT-L/142026.06 | 87.7 | 92.5 | |
| Iso-CBackbone=ViT-L/142026.06 | 87.6 | 92.2 | |
| PACT-TSV-MBackbone=ViT-B/162026.06 | 83.8 | 89.6 | |
| PACT-Iso-CBackbone=ViT-B/162026.06 | 83.4 | 89.3 | |
| PACT-TABackbone=ViT-L/142026.06 | 83 | 87.7 | |
| Iso-CTSBackbone=ViT-B/162026.06 | 82.4 | 88.4 | |
| TSV-MBackbone=ViT-B/162026.06 | 80.6 | 86.5 | |
| PACT-TSV-MBackbone=ViT-B/322026.06 | 80.3 | 87.6 | |
| Iso-CBackbone=ViT-B/162026.06 | 79.6 | 85.4 | |
| Consensus TABackbone=ViT-L/142026.06 | 79 | 83.2 | |
| PACT-Iso-CBackbone=ViT-B/322026.06 | 78.7 | 86 | |
| Iso-CTSBackbone=ViT-B/322026.06 | 78.1 | 85.5 | |
| TSV-MBackbone=ViT-B/322026.06 | 77.1 | 84.3 | |
| TIESBackbone=ViT-L/142026.06 | 75.7 | 79.8 | |
| Iso-CBackbone=ViT-B/322026.06 | 75.5 | 82.5 | |
| Task ArithmeticBackbone=ViT-L/142026.06 | 74 | 78.1 | |
| Weight AveragingBackbone=ViT-L/142026.06 | 71.6 | 75.6 | |
| Consensus TABackbone=ViT-B/162026.06 | 69.8 | 74.9 | |
| PACT-TABackbone=ViT-B/162026.06 | 68.7 | 74 | |
| TIESBackbone=ViT-B/162026.06 | 68.2 | 73.3 | |
| Task ArithmeticBackbone=ViT-B/162026.06 | 65.8 | 70.8 | |
| Consensus TABackbone=ViT-B/322026.06 | 65.4 | 72 | |
| Weight AveragingBackbone=ViT-B/162026.06 | 65.3 | 70.4 | |
| Zero-shotBackbone=ViT-L/142026.06 | 65.2 | — | |
| Pre-trainedBackbone=ViT-L/142026.06 | 65.2 | — | |
| TIESBackbone=ViT-B/322026.06 | 63.4 | 69.9 | |
| Weight AveragingBackbone=ViT-B/322026.06 | 61 | 67.5 | |
| Model SoupBackbone=ViT-B/32, Merging Category=Static Merging2026.06 | 61 | 67.5 | |
| Task ArithmeticBackbone=ViT-B/322026.06 | 60.5 | 66.8 | |
| PACT-TABackbone=ViT-B/322026.06 | 59.9 | 66.4 | |
| Zero-shotBackbone=ViT-B/162026.06 | 59.7 | — | |
| Zero-shotBackbone=ViT-B/322026.06 | 56.1 | — |