Image Classification on CLIP benchmark (test)
93AccuracyTSV
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TSVBackbone=ViT-L-14, Number of tasks (T)=8, Hyperparameter selection strategy=Eval2026.04 | 93 | — | |
| TSVBackbone=ViT-L-14, Number of tasks (T)=8, Hyperparameter selection strategy=TAP2026.04 | 93 | — | |
| AdaMergingBackbone=ViT-L-14, Number of tasks (T)=8, Hyperparameter selection strategy=Entropy2026.04 | 91.7 | — | |
| AdaMergingBackbone=ViT-L-14, Number of tasks (T)=8, Hyperparameter selection strategy=TAP2026.04 | 91.4 | — | |
| TSVBackbone=ViT-L-14, Number of tasks (T)=14, Hyperparameter selection strategy=Eval2026.04 | 89.2 | — | |
| TSVBackbone=ViT-L-14, Number of tasks (T)=14, Hyperparameter selection strategy=TAP2026.04 | 89.1 | — | |
| AdaMergingBackbone=ViT-L-14, Number of tasks (T)=14, Hyperparameter selection strategy=Entropy2026.04 | 87.7 | — | |
| TSVBackbone=ViT-L-14, Number of tasks (T)=20, Hyperparameter selection strategy=TAP2026.04 | 87.6 | — | |
| TSVBackbone=ViT-L-14, Number of tasks (T)=20, Hyperparameter selection strategy=Eval2026.04 | 87.5 | — | |
| AdaMergingBackbone=ViT-L-14, Number of tasks (T)=20, Hyperparameter selection strategy=Entropy2026.04 | 87.1 | — | |
| TIESBackbone=ViT-L-14, Number of tasks (T)=8, Hyperparameter selection strategy=TAP2026.04 | 87 | — | |
| AdaMergingBackbone=ViT-L-14, Number of tasks (T)=14, Hyperparameter selection strategy=TAP2026.04 | 87 | — | |
| TIESBackbone=ViT-L-14, Number of tasks (T)=8, Hyperparameter selection strategy=Eval2026.04 | 86.9 | — | |
| ConsensusBackbone=ViT-L-14, Number of tasks (T)=8, Hyperparameter selection strategy=Eval2026.04 | 86.3 | — | |
| ConsensusBackbone=ViT-L-14, Number of tasks (T)=8, Hyperparameter selection strategy=TAP2026.04 | 86.3 | — | |
| TSVBackbone=ViT-B-32, Number of tasks (T)=8, Hyperparameter selection strategy=Eval2026.04 | 85.8 | — | |
| TSVBackbone=ViT-B-32, Number of tasks (T)=8, Hyperparameter selection strategy=TAP2026.04 | 85.5 | — | |
| TABackbone=ViT-L-14, Number of tasks (T)=8, Hyperparameter selection strategy=Eval2026.04 | 84.9 | — | |
| TABackbone=ViT-L-14, Number of tasks (T)=8, Hyperparameter selection strategy=TAP2026.04 | 84.9 | — | |
| STARBackbone=ViT-L-14, Number of tasks (T)=8, Hyperparameter selection strategy=Eval2026.04 | 84.9 | — | |
| STARBackbone=ViT-L-14, Number of tasks (T)=8, Hyperparameter selection strategy=TAP2026.04 | 84.9 | — | |
| AdaMergingBackbone=ViT-L-14, Number of tasks (T)=20, Hyperparameter selection strategy=TAP2026.04 | 84.3 | — | |
| AdaMergingBackbone=ViT-B-32, Number of tasks (T)=8, Hyperparameter selection strategy=TAP2026.04 | 84.2 | — | |
| ConsensusBackbone=ViT-L-14, Number of tasks (T)=14, Hyperparameter selection strategy=Eval2026.04 | 82.3 | — | |
| ConsensusBackbone=ViT-L-14, Number of tasks (T)=14, Hyperparameter selection strategy=TAP2026.04 | 82.3 | — | |
| AdaMergingBackbone=ViT-B-32, Number of tasks (T)=8, Hyperparameter selection strategy=Entropy2026.04 | 80.7 | — | |
| TIESBackbone=ViT-L-14, Number of tasks (T)=14, Hyperparameter selection strategy=Eval2026.04 | 80.2 | — | |
| TIESBackbone=ViT-L-14, Number of tasks (T)=14, Hyperparameter selection strategy=TAP2026.04 | 80.2 | — | |
| TSVBackbone=ViT-B-32, Number of tasks (T)=14, Hyperparameter selection strategy=Eval2026.04 | 80 | — | |
| TSVBackbone=ViT-B-32, Number of tasks (T)=14, Hyperparameter selection strategy=TAP2026.04 | 80 | — | |
| TABackbone=ViT-L-14, Number of tasks (T)=14, Hyperparameter selection strategy=TAP2026.04 | 79.7 | — | |
| STARBackbone=ViT-L-14, Number of tasks (T)=14, Hyperparameter selection strategy=Eval2026.04 | 79.7 | — | |
| STARBackbone=ViT-L-14, Number of tasks (T)=14, Hyperparameter selection strategy=TAP2026.04 | 79.7 | — | |
| ConsensusBackbone=ViT-L-14, Number of tasks (T)=20, Hyperparameter selection strategy=Eval2026.04 | 79.6 | — | |
| ConsensusBackbone=ViT-L-14, Number of tasks (T)=20, Hyperparameter selection strategy=TAP2026.04 | 79.6 | — | |
| TABackbone=ViT-L-14, Number of tasks (T)=14, Hyperparameter selection strategy=Eval2026.04 | 79.4 | — | |
| TIESBackbone=ViT-L-14, Number of tasks (T)=20, Hyperparameter selection strategy=Eval2026.04 | 77.1 | — | |
| TIESBackbone=ViT-L-14, Number of tasks (T)=20, Hyperparameter selection strategy=TAP2026.04 | 77.1 | — | |
| TSVBackbone=ViT-B-32, Number of tasks (T)=20, Hyperparameter selection strategy=Eval2026.04 | 76.9 | — | |
| TSVBackbone=ViT-B-32, Number of tasks (T)=20, Hyperparameter selection strategy=TAP2026.04 | 76.9 | — | |
| STARBackbone=ViT-L-14, Number of tasks (T)=20, Hyperparameter selection strategy=Eval2026.04 | 76.1 | — | |
| STARBackbone=ViT-L-14, Number of tasks (T)=20, Hyperparameter selection strategy=TAP2026.04 | 76.1 | — | |
| TABackbone=ViT-L-14, Number of tasks (T)=20, Hyperparameter selection strategy=Eval2026.04 | 76 | — | |
| TABackbone=ViT-L-14, Number of tasks (T)=20, Hyperparameter selection strategy=TAP2026.04 | 76 | — | |
| AdaMergingBackbone=ViT-B-32, Number of tasks (T)=14, Hyperparameter selection strategy=Entropy2026.04 | 75.4 | — | |
| AdaMergingBackbone=ViT-B-32, Number of tasks (T)=14, Hyperparameter selection strategy=TAP2026.04 | 75 | — | |
| ConsensusBackbone=ViT-B-32, Number of tasks (T)=8, Hyperparameter selection strategy=Eval2026.04 | 74.9 | — | |
| TIESBackbone=ViT-B-32, Number of tasks (T)=8, Hyperparameter selection strategy=Eval2026.04 | 74.8 | — | |
| ConsensusBackbone=ViT-B-32, Number of tasks (T)=8, Hyperparameter selection strategy=TAP2026.04 | 74.7 | — | |
| TIESBackbone=ViT-B-32, Number of tasks (T)=8, Hyperparameter selection strategy=TAP2026.04 | 74.5 | — | |
| AdaMergingBackbone=ViT-B-32, Number of tasks (T)=20, Hyperparameter selection strategy=Entropy2026.04 | 72.4 | — | |
| AdaMergingBackbone=ViT-B-32, Number of tasks (T)=20, Hyperparameter selection strategy=TAP2026.04 | 71.5 | — | |
| STARBackbone=ViT-B-32, Number of tasks (T)=8, Hyperparameter selection strategy=Eval2026.04 | 71.4 | — | |
| TABackbone=ViT-B-32, Number of tasks (T)=8, Hyperparameter selection strategy=Eval2026.04 | 71.1 | — | |
| TABackbone=ViT-B-32, Number of tasks (T)=8, Hyperparameter selection strategy=TAP2026.04 | 71.1 | — | |
| STARBackbone=ViT-B-32, Number of tasks (T)=8, Hyperparameter selection strategy=TAP2026.04 | 70.9 | — | |
| ConsensusBackbone=ViT-B-32, Number of tasks (T)=14, Hyperparameter selection strategy=Eval2026.04 | 70.3 | — | |
| ConsensusBackbone=ViT-B-32, Number of tasks (T)=14, Hyperparameter selection strategy=TAP2026.04 | 70.3 | — | |
| TIESBackbone=ViT-B-32, Number of tasks (T)=14, Hyperparameter selection strategy=Eval2026.04 | 67.8 | — | |
| TIESBackbone=ViT-B-32, Number of tasks (T)=14, Hyperparameter selection strategy=TAP2026.04 | 67.8 | — | |
| ConsensusBackbone=ViT-B-32, Number of tasks (T)=20, Hyperparameter selection strategy=Eval2026.04 | 66.9 | — | |
| ConsensusBackbone=ViT-B-32, Number of tasks (T)=20, Hyperparameter selection strategy=TAP2026.04 | 66.9 | — | |
| STARBackbone=ViT-B-32, Number of tasks (T)=14, Hyperparameter selection strategy=Eval2026.04 | 65.4 | — | |
| STARBackbone=ViT-B-32, Number of tasks (T)=14, Hyperparameter selection strategy=TAP2026.04 | 65.3 | — | |
| TABackbone=ViT-B-32, Number of tasks (T)=14, Hyperparameter selection strategy=Eval2026.04 | 65.2 | — | |
| TABackbone=ViT-B-32, Number of tasks (T)=14, Hyperparameter selection strategy=TAP2026.04 | 65 | — | |
| TIESBackbone=ViT-B-32, Number of tasks (T)=20, Hyperparameter selection strategy=Eval2026.04 | 64.8 | — | |
| TIESBackbone=ViT-B-32, Number of tasks (T)=20, Hyperparameter selection strategy=TAP2026.04 | 64.8 | — | |
| STARBackbone=ViT-B-32, Number of tasks (T)=20, Hyperparameter selection strategy=TAP2026.04 | 63 | — | |
| STARBackbone=ViT-B-32, Number of tasks (T)=20, Hyperparameter selection strategy=Eval2026.04 | 62.9 | — | |
| TABackbone=ViT-B-32, Number of tasks (T)=20, Hyperparameter selection strategy=Eval2026.04 | 62.6 | — | |
| TABackbone=ViT-B-32, Number of tasks (T)=20, Hyperparameter selection strategy=TAP2026.04 | 62.1 | — | |
| AdaMergingHyperparameter selection strategy=TAP2026.04 | — | 81.1 | |
| AdaMergingHyperparameter selection strategy=Entropy2026.04 | — | 81.5 | |
| ConsensusHyperparameter selection strategy=Eval2026.04 | — | 76.2 | |
| ConsensusHyperparameter selection strategy=TAP2026.04 | — | 76.2 | |
| STARHyperparameter selection strategy=Eval2026.04 | — | 72.9 | |
| STARHyperparameter selection strategy=TAP2026.04 | — | 72.8 | |
| TAHyperparameter selection strategy=Eval2026.04 | — | 72.7 | |
| TAHyperparameter selection strategy=TAP2026.04 | — | 72.5 | |
| TIESHyperparameter selection strategy=Eval2026.04 | — | 74.9 | |
| TIESHyperparameter selection strategy=TAP2026.04 | — | 74.9 | |
| TSVHyperparameter selection strategy=Eval2026.04 | — | 85.2 | |
| TSVHyperparameter selection strategy=TAP2026.04 | — | 85.1 |