Multi-task Image Classification on 20 Vision Tasks
94.8AccuracyIndividual
Evaluation results
| Method | Links | ||
|---|---|---|---|
| IndividualBackbone=ViT-L/142026.06 | 94.8 | — | |
| ReTeXBackbone=ViT-L/142026.06 | 93.6 | 98.7 | |
| IndividualBackbone=ViT-B/162026.06 | 92.8 | — | |
| ReTeXBackbone=ViT-B/162026.06 | 91.7 | 98.8 | |
| IndividualBackbone=ViT-B/322026.06 | 91.4 | — | |
| IndividualBackbone=ViT-B/322026.06 | 91.4 | — | |
| ReTeXBackbone=ViT-B/322026.06 | 89.8 | 98.3 | |
| ReTeXBackbone=ViT-B/32, Merging Type=Dynamic model merging2026.06 | 89.4 | 97.9 | |
| MoW-MergingBackbone=ViT-L/142026.06 | 81.8 | 86.3 | |
| MoW-MergingBackbone=ViT-B/32, Merging Type=Dynamic model merging2026.06 | 79.3 | 86.8 | |
| MoW-MergingBackbone=ViT-B/322026.06 | 79.3 | 86.8 | |
| Consensus TABackbone=ViT-L/142026.06 | 79 | 83.3 | |
| WEMoEBackbone=ViT-B/162026.06 | 78.8 | 84.9 | |
| MoW-MergingBackbone=ViT-B/162026.06 | 78.2 | 84.3 | |
| AdaMergingBackbone=ViT-L/142026.06 | 77.8 | 82.1 | |
| DaWinBackbone=ViT-L/142026.06 | 77.5 | 81.8 | |
| WEMoEBackbone=ViT-L/142026.06 | 75.7 | 79.9 | |
| Twin-MergingBackbone=ViT-L/142026.06 | 74.8 | 78.9 | |
| WEMoEBackbone=ViT-B/32, Merging Type=Dynamic model merging2026.06 | 74.4 | 81.2 | |
| WEMoEBackbone=ViT-B/322026.06 | 74.4 | 81.4 | |
| Task ArithmeticBackbone=ViT-L/142026.06 | 74.1 | 78.2 | |
| TIES-MergingBackbone=ViT-L/142026.06 | 72.9 | 76.9 | |
| Weight AveragingBackbone=ViT-L/142026.06 | 71.6 | 75.5 | |
| Consensus TABackbone=ViT-B/162026.06 | 69.8 | 75.2 | |
| AdaMergingBackbone=ViT-B/162026.06 | 69.6 | 75 | |
| TIES-MergingBackbone=ViT-B/162026.06 | 66.6 | 71.8 | |
| AdaMergingBackbone=ViT-B/32, Merging Type=Static model merging2026.06 | 66.2 | 72.7 | |
| AdaMergingBackbone=ViT-B/322026.06 | 66.2 | 72.4 | |
| Task ArithmeticBackbone=ViT-B/162026.06 | 65.8 | 70.9 | |
| Consensus TABackbone=ViT-B/32, Merging Type=Static model merging2026.06 | 65.4 | 72 | |
| Consensus TABackbone=ViT-B/322026.06 | 65.4 | 71.5 | |
| Weight AveragingBackbone=ViT-B/162026.06 | 65.3 | 70.4 | |
| Zero-shotBackbone=ViT-L/142026.06 | 65.2 | — | |
| Twin-MergingBackbone=ViT-B/162026.06 | 63.1 | 68 | |
| DaWinBackbone=ViT-B/162026.06 | 62.8 | 67.7 | |
| TIES-MergingBackbone=ViT-B/32, Merging Type=Static model merging2026.06 | 62.3 | 68.8 | |
| TIES-MergingBackbone=ViT-B/322026.06 | 62.3 | 68.2 | |
| Weight AveragingBackbone=ViT-B/32, Merging Type=Static model merging2026.06 | 61 | 67.5 | |
| Weight AveragingBackbone=ViT-B/322026.06 | 61 | 66.7 | |
| Task ArithmeticBackbone=ViT-B/32, Merging Type=Static model merging2026.06 | 60.5 | 66.7 | |
| Task ArithmeticBackbone=ViT-B/322026.06 | 60.5 | 66.2 | |
| Zero-shotBackbone=ViT-B/162026.06 | 59.7 | — | |
| Twin-MergingBackbone=ViT-B/32, Merging Type=Dynamic model merging2026.06 | 57.5 | 61.8 | |
| Twin-MergingBackbone=ViT-B/322026.06 | 57.5 | 62.9 | |
| Zero-shotBackbone=ViT-B/322026.06 | 56.1 | — | |
| Zero-shotBackbone=ViT-B/322026.06 | 56.1 | — | |
| DaWinBackbone=ViT-B/32, Merging Type=Dynamic model merging2026.06 | 52.8 | 57.7 | |
| DaWinBackbone=ViT-B/322026.06 | 52.8 | 57.8 |