Multi-task Image Classification on 8 Vision Tasks (Low Confidence setting, test)
94Absolute AccuracyIndividual
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| IndividualBackbone=ViT-L-142025.08 | 94 | — | |
| EMR-Merging + DisTaCBackbone=ViT-L-142025.08 | 92.3 | 98.1 | |
| WUDI-Merging + DisTaCBackbone=ViT-L-142025.08 | 91.6 | 97.3 | |
| IndividualBackbone=ViT-B-322025.08 | 89.8 | — | |
| TSVM + DisTaCBackbone=ViT-L-142025.08 | 89.7 | 96.2 | |
| Iso-CTS + DisTaCBackbone=ViT-L-142025.08 | 86.1 | 915 | |
| TSVM + DisTaCBackbone=ViT-B-322025.08 | 81.5 | 91.8 | |
| Iso-CTSBackbone=ViT-L-142025.08 | 80.8 | 86 | |
| Consensus TA + DisTaCBackbone=ViT-L-142025.08 | 80 | 85.8 | |
| TIES + DisTaCBackbone=ViT-L-142025.08 | 79.4 | 85.4 | |
| Task arithmetic + DisTaCBackbone=ViT-L-142025.08 | 77.6 | 83.3 | |
| WUDI-Merging + DisTaCBackbone=ViT-B-322025.08 | 73.8 | 83.3 | |
| Iso-CTSBackbone=ViT-B-322025.08 | 72.5 | 81.1 | |
| TSVMBackbone=ViT-L-142025.08 | 71.6 | 76.4 | |
| EMR-Merging + DisTaCBackbone=ViT-B-322025.08 | 70.3 | 79.2 | |
| Iso-CTS + DisTaCBackbone=ViT-B-322025.08 | 69 | 78.1 | |
| TIES + DisTaCBackbone=ViT-B-322025.08 | 68.7 | 77.9 | |
| Consensus TABackbone=ViT-L-142025.08 | 68.6 | 73.2 | |
| TIESBackbone=ViT-L-142025.08 | 68.3 | 73 | |
| Consensus TA + DisTaCBackbone=ViT-B-322025.08 | 67.7 | 76.5 | |
| Task arithmeticBackbone=ViT-L-142025.08 | 66.9 | 71.5 | |
| Pre-trainedBackbone=ViT-L-142025.08 | 65.1 | — | |
| Task arithmetic + DisTaCBackbone=ViT-B-322025.08 | 63.6 | 72.2 | |
| TSVMBackbone=ViT-B-322025.08 | 60.7 | 68.4 | |
| Consensus TABackbone=ViT-B-322025.08 | 54.6 | 62 | |
| TIESBackbone=ViT-B-322025.08 | 54.5 | 62 | |
| Task arithmeticBackbone=ViT-B-322025.08 | 51 | 58.3 | |
| Pre-trainedBackbone=ViT-B-322025.08 | 47.3 | — | |
| EMR-MergingBackbone=ViT-B-322025.08 | 39.2 | 45.1 | |
| WUDI-MergingBackbone=ViT-B-322025.08 | 38 | 40.8 | |
| WUDI-MergingBackbone=ViT-L-142025.08 | 28 | 29.2 | |
| EMR-MergingBackbone=ViT-L-142025.08 | 27.4 | 30.1 |