Image Classification on 8 Vision Tasks Aggregate (ViT-B/32 ViT-L/14 average)
94.3AccuracyNPS
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| NPSBackbone=ViT-L/142025.05 | 94.3 | 18 | — | — | — | — | — | — | — | — | |
| Fine-tunedBackbone=ViT-L/142025.05 | 94.2 | 79.1 | — | — | — | — | — | — | — | — | |
| IndividualBackbone=ViT-L/14, Merging Regime=Non-merging2025.11 | 94.2 | — | 82.3 | 92.4 | 97.4 | 100 | 98.1 | 99.2 | 99.7 | 84.1 | |
| TallS+TIESBackbone=ViT-L/142025.05 | 93.6 | 23.1 | — | — | — | — | — | — | — | — | |
| Traditional MTLBackbone=ViT-L/14, Merging Regime=Non-merging2025.11 | 93.5 | — | 80.8 | 90.6 | 96.3 | 96.3 | 97.6 | 99.1 | 99.6 | 84.4 | |
| MDA AMBackbone=ViT-L/14, Merging Regime=Data-based Optimization2025.11 | 92.7 | — | 79.1 | 91 | 94.7 | 98.9 | 95.9 | 97.9 | 99.7 | 84 | |
| MDA TABackbone=ViT-L/14, Merging Regime=Data-free2025.11 | 92 | — | 79.1 | 90.6 | 94.7 | 98.7 | 95.6 | 97 | 99.6 | 80.4 | |
| AWD AMBackbone=ViT-L/14, Merging Regime=Data-based Optimization2025.11 | 91.5 | — | 79.8 | 90.6 | 91.8 | 97 | 93.9 | 98.4 | 99.2 | 81.1 | |
| TSV TABackbone=ViT-L/14, Merging Regime=Data-free2025.11 | 91.3 | — | 78.3 | 90 | 94.1 | 98.5 | 95.2 | 96.1 | 99.5 | 78.9 | |
| ISO AMBackbone=ViT-L/14, Merging Regime=Data-free2025.11 | 91.1 | — | 79.9 | 90.9 | 94.8 | 98.3 | 91.4 | 95.5 | 99.2 | 79.2 | |
| Concrete AMBackbone=ViT-L/14, Merging Regime=Data-based Optimization2025.11 | 91.1 | — | 77.8 | 91.2 | 92.1 | 97 | 94.4 | 97.9 | 99 | 79.5 | |
| AdaMerging++Backbone=ViT-L/14, Merging Regime=Data-based Optimization2025.11 | 91 | — | 79.4 | 90.3 | 91.6 | 97.4 | 93.4 | 97.5 | 99 | 79.2 | |
| NPSBackbone=ViT-B/322025.05 | 90.9 | 5.9 | — | — | — | — | — | — | — | — | |
| AdaMergingBackbone=ViT-L/14, Merging Regime=Data-based Optimization2025.11 | 90.8 | — | 79 | 90.3 | 90.8 | 96.2 | 93.4 | 98 | 99 | 79.9 | |
| Fine-tunedBackbone=ViT-B/322025.05 | 90.5 | 23.3 | — | — | — | — | — | — | — | — | |
| TallS+TIESBackbone=ViT-B/322025.05 | 90.2 | 7.1 | — | — | — | — | — | — | — | — | |
| Representation SurgeryBackbone=ViT-L/14, Merging Regime=Data-based Optimization2025.11 | 89 | — | 75.7 | 84.4 | 93.1 | 98.8 | 91.3 | 93.4 | 99.1 | 76.1 | |
| DOGE TABackbone=ViT-L/14, Merging Regime=Data-free2025.11 | 88.8 | — | 76.7 | 87.7 | 91.6 | 96.2 | 94.4 | 93.4 | 98.9 | 71.6 | |
| AWD TABackbone=ViT-L/14, Merging Regime=Data-free2025.11 | 87.5 | — | 76.2 | 85.4 | 88.7 | 96.1 | 92.4 | 92.3 | 99.3 | 69.4 | |
| PCB-MergingBackbone=ViT-L/14, Merging Regime=Data-free2025.11 | 87.5 | — | 76.8 | 86.2 | 89.4 | 96.5 | 88.3 | 91 | 98.6 | 73.6 | |
| Concrete TABackbone=ViT-L/14, Merging Regime=Data-free2025.11 | 87.4 | — | 86.2 | 66.9 | 96.7 | 93.4 | 99.1 | 89 | 74.6 | 93.6 | |
| TIESBackbone=ViT-L/142025.05 | 86 | 11 | — | — | — | — | — | — | — | — | |
| Ties-MergingBackbone=ViT-L/14, Merging Regime=Data-free2025.11 | 86 | — | 76.5 | 85 | 89.3 | 95.7 | 90.3 | 83.3 | 99 | 68.8 | |
| Consensus MergingBackbone=ViT-L/14, Merging Regime=Data-free2025.11 | 85.2 | — | 75 | 84.3 | 89.4 | 95.6 | 88.3 | 82.4 | 98.9 | 68 | |
| Task ArithmeticBackbone=ViT-L/142025.05 | 84.5 | 11 | — | — | — | — | — | — | — | — | |
| Task ArithmeticBackbone=ViT-L/14, Merging Regime=Data-free2025.11 | 84.5 | — | 73.9 | 82.1 | 86.6 | 94.1 | 87.9 | 86.7 | 98.9 | 65.6 | |
| Zero-shotBackbone=ViT-L/142025.05 | 74.5 | 11 | — | — | — | — | — | — | — | — | |
| TIESBackbone=ViT-B/322025.05 | 73.6 | 3.6 | — | — | — | — | — | — | — | — | |
| Task ArithmeticBackbone=ViT-B/322025.05 | 70.1 | 3.6 | — | — | — | — | — | — | — | — | |
| Pre-trainedBackbone=ViT-L/14, Merging Regime=Non-merging2025.11 | 64.5 | — | 66.8 | 77.7 | 71 | 59.9 | 58.4 | 50.5 | 76.3 | 55.3 | |
| Zero-shotBackbone=ViT-B/322025.05 | 62.3 | 3.6 | — | — | — | — | — | — | — | — |