Multi-task model merging on 14 vision tasks
94.3Average Absolute AccuracyFine-tuned
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Fine-tunedBackbone=ViT-L/142026.06 | 94.3 | — | |
| ESM++Backbone=ViT-L/14, Merging Category=Dynamic Merging, Rank (r)=322026.06 | 93.2 | 98.8 | |
| Fine-tunedBackbone=ViT-B/162026.06 | 92.8 | — | |
| Iso-CTSBackbone=ViT-L/142026.06 | 91 | 96.3 | |
| Fine-tunedBackbone=ViT-B/322026.06 | 90.9 | — | |
| PACT-Iso-CBackbone=ViT-L/142026.06 | 90.5 | 95.5 | |
| PACT-TSV-MBackbone=ViT-L/142026.06 | 89.5 | 94.4 | |
| Iso-CBackbone=ViT-L/142026.06 | 89.3 | 94.5 | |
| TSV-MBackbone=ViT-L/142026.06 | 89.2 | 94.4 | |
| ESM++Backbone=ViT-B/32, Merging Category=Dynamic Merging, Rank (r)=322026.06 | 88 | 96.8 | |
| PACT-TABackbone=ViT-L/142026.06 | 87 | 92 | |
| Iso-CTSBackbone=ViT-B/162026.06 | 86.4 | 92.8 | |
| PACT-Iso-CBackbone=ViT-B/162026.06 | 86.1 | 92.3 | |
| PACT-TSV-MBackbone=ViT-B/162026.06 | 85.4 | 91.5 | |
| Iso-CBackbone=ViT-B/162026.06 | 84.8 | 91.1 | |
| TSV-MBackbone=ViT-B/162026.06 | 84.6 | 91 | |
| ESMBackbone=ViT-B/32, Merging Category=Static Merging2026.06 | 83.9 | 92.4 | |
| Consensus TABackbone=ViT-L/142026.06 | 82.2 | 86.9 | |
| PACT-TSV-MBackbone=ViT-B/322026.06 | 82 | 89.6 | |
| Iso-CTSBackbone=ViT-B/322026.06 | 81.7 | 89.7 | |
| PACT-Iso-CBackbone=ViT-B/322026.06 | 81.3 | 89 | |
| Iso-CBackbone=ViT-B/322026.06 | 80.3 | 88.1 | |
| TSV-MBackbone=ViT-B/322026.06 | 80.1 | 87.9 | |
| TIESBackbone=ViT-L/142026.06 | 79.5 | 84.1 | |
| Task ArithmeticBackbone=ViT-L/142026.06 | 79.4 | 84 | |
| PACT-TABackbone=ViT-B/162026.06 | 76.8 | 82.7 | |
| Weight AveragingBackbone=ViT-L/142026.06 | 76.7 | 81.1 | |
| Consensus TABackbone=ViT-B/162026.06 | 74.4 | 79.9 | |
| TIESBackbone=ViT-B/162026.06 | 73.2 | 78.7 | |
| Task ArithmeticBackbone=ViT-B/162026.06 | 70.5 | 75.9 | |
| Task ArithmeticBackbone=ViT-B/16, Merging Category=Static Merging2026.06 | 70.5 | 75.9 | |
| Consensus TABackbone=ViT-B/322026.06 | 70.4 | 77.4 | |
| Weight AveragingBackbone=ViT-B/162026.06 | 69.5 | 74.8 | |
| Zero-shotBackbone=ViT-L/142026.06 | 68.2 | — | |
| TIESBackbone=ViT-B/322026.06 | 68 | 74.8 | |
| PACT-TABackbone=ViT-B/322026.06 | 66.4 | 73.3 | |
| Task ArithmeticBackbone=ViT-B/322026.06 | 65.3 | 72.1 | |
| Weight AveragingBackbone=ViT-B/322026.06 | 64.3 | 71.1 | |
| Model SoupBackbone=ViT-B/32, Merging Category=Static Merging2026.06 | 64.3 | 71.1 | |
| Zero-shotBackbone=ViT-B/162026.06 | 61.3 | — | |
| Zero-shotBackbone=ViT-B/322026.06 | 57.2 | — | |
| Pre-trainedBackbone=ViT-B/322026.06 | 57.2 | — |