Image Classification on 20 tasks collection
94Average Absolute AccuracyFinetuned
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FinetunedBackbone=ViT-L-142025.04 | 94 | 100 | |
| FinetunedBackbone=ViT-B-162025.04 | 91.9 | 100 | |
| MASSBackbone=ViT-L-142025.04 | 90.8 | 96.6 | |
| FinetunedBackbone=ViT-B-322025.04 | 89.5 | 100 | |
| Iso-CTSBackbone=ViT-L-142025.04 | 89.2 | 94.9 | |
| TSV-MBackbone=ViT-L-142025.04 | 87.5 | 93 | |
| Iso-CBackbone=ViT-L-142025.04 | 86.8 | 92.3 | |
| SMILE-2Backbone=ViT-L-142025.04 | 85.5 | 91.1 | |
| SMILE-1Backbone=ViT-L-142025.04 | 84.9 | 90.5 | |
| MASSBackbone=ViT-B-322025.04 | 81.1 | 90.9 | |
| MASSBackbone=ViT-B-162025.04 | 81.1 | 88.7 | |
| Iso-CTSBackbone=ViT-B-162025.04 | 80.7 | 87.7 | |
| SMILE-2Backbone=ViT-B-162025.04 | 80.4 | 87.7 | |
| SMILE-1Backbone=ViT-B-162025.04 | 79.5 | 86.7 | |
| Consensus TABackbone=ViT-L-142025.04 | 78.9 | 83.8 | |
| TSV-MBackbone=ViT-B-162025.04 | 78.8 | 85.5 | |
| RegMean++Backbone=ViT-L/14, Number of tasks merged=20, Method Category=Training-Free Methods2025.08 | 77.8 | — | |
| DOGE AMBackbone=ViT-L/14, Number of tasks merged=20, Method Category=Test-Time Adaption Methods2025.08 | 77.6 | — | |
| RegMeanBackbone=ViT-L/14, Number of tasks merged=20, Method Category=Training-Free Methods2025.08 | 77.2 | — | |
| Iso-CTSBackbone=ViT-B-322025.04 | 77 | 86.2 | |
| Task ArithmeticBackbone=ViT-L-142025.04 | 76.9 | 81.7 | |
| Weight AveragingBackbone=ViT-L-142025.04 | 76.1 | 80.9 | |
| TSV-MBackbone=ViT-L/14, Number of tasks merged=20, Method Category=Data-Free Methods2025.08 | 75.7 | — | |
| TSV-MBackbone=ViT-B-322025.04 | 75.6 | 84.3 | |
| RegMean++Backbone=ViT-L/14, Number of tasks merged=16, Method Category=Training-Free Methods2025.08 | 75.6 | — | |
| RegMeanBackbone=ViT-L/14, Number of tasks merged=16, Method Category=Training-Free Methods2025.08 | 75.5 | — | |
| Iso-CBackbone=ViT-B-162025.04 | 75.3 | 81.6 | |
| RegMeanBackbone=ViT-L/14, Number of tasks merged=12, Method Category=Training-Free Methods2025.08 | 75.2 | — | |
| Layer-wise AdaMergingBackbone=ViT-L/14, Number of tasks merged=20, Method Category=Test-Time Adaption Methods2025.08 | 75.2 | — | |
| RegMean++Backbone=ViT-L/14, Number of tasks merged=12, Method Category=Training-Free Methods2025.08 | 75 | — | |
| DOGE AMBackbone=ViT-L/14, Number of tasks merged=16, Method Category=Test-Time Adaption Methods2025.08 | 74.8 | — | |
| RegMean++Backbone=ViT-L/14, Number of tasks merged=8, Method Category=Training-Free Methods2025.08 | 74.7 | — | |
| RegMeanBackbone=ViT-L/14, Number of tasks merged=8, Method Category=Training-Free Methods2025.08 | 74.6 | — | |
| TSV-MBackbone=ViT-L/14, Number of tasks merged=16, Method Category=Data-Free Methods2025.08 | 74.2 | — | |
| SMILE-2Backbone=ViT-B-322025.04 | 74.1 | 83.8 | |
| DOGE TABackbone=ViT-L/14, Number of tasks merged=20, Method Category=Data-Free Methods2025.08 | 74 | — | |
| DOGE AMBackbone=ViT-L/14, Number of tasks merged=12, Method Category=Test-Time Adaption Methods2025.08 | 74 | — | |
| Layer-wise AdaMergingBackbone=ViT-L/14, Number of tasks merged=16, Method Category=Test-Time Adaption Methods2025.08 | 73.4 | — | |
| Iso-CBackbone=ViT-B-322025.04 | 73.2 | 81.9 | |
| TSV-MBackbone=ViT-L/14, Number of tasks merged=12, Method Category=Data-Free Methods2025.08 | 73.2 | — | |
| Layer-wise AdaMergingBackbone=ViT-L/14, Number of tasks merged=12, Method Category=Test-Time Adaption Methods2025.08 | 73.2 | — | |
| TSV-MBackbone=ViT-L/14, Number of tasks merged=8, Method Category=Data-Free Methods2025.08 | 73.1 | — | |
| Iso-CBackbone=ViT-L/14, Number of tasks merged=8, Method Category=Data-Free Methods2025.08 | 73.1 | — | |
| SMILE-1Backbone=ViT-B-322025.04 | 72.8 | 82.3 | |
| DOGE TABackbone=ViT-L/14, Number of tasks merged=8, Method Category=Data-Free Methods2025.08 | 72.7 | — | |
| Layer-wise AdaMergingBackbone=ViT-L/14, Number of tasks merged=8, Method Category=Test-Time Adaption Methods2025.08 | 72.4 | — | |
| DOGE TABackbone=ViT-L/14, Number of tasks merged=12, Method Category=Data-Free Methods2025.08 | 72.3 | — | |
| Consensus TABackbone=ViT-B-162025.04 | 72.2 | 78.4 | |
| DOGE TABackbone=ViT-L/14, Number of tasks merged=16, Method Category=Data-Free Methods2025.08 | 72.2 | — | |
| Iso-CBackbone=ViT-L/14, Number of tasks merged=12, Method Category=Data-Free Methods2025.08 | 71.5 | — | |
| DOGE AMBackbone=ViT-L/14, Number of tasks merged=8, Method Category=Test-Time Adaption Methods2025.08 | 70.9 | — | |
| TIES-MergingBackbone=ViT-L/14, Number of tasks merged=20, Method Category=Data-Free Methods2025.08 | 70.5 | — | |
| Iso-CBackbone=ViT-L/14, Number of tasks merged=4, Method Category=Data-Free Methods2025.08 | 70.5 | — | |
| Iso-CTSBackbone=ViT-L/14, Number of tasks merged=8, Method Category=Data-Free Methods2025.08 | 70.4 | — | |
| Model SoupsBackbone=ViT-L/14, Number of tasks merged=20, Method Category=Data-Free Methods2025.08 | 70.2 | — | |
| TIES-MergingBackbone=ViT-L/14, Number of tasks merged=12, Method Category=Data-Free Methods2025.08 | 70.2 | — | |
| DOGE TABackbone=ViT-L/14, Number of tasks merged=4, Method Category=Data-Free Methods2025.08 | 70.2 | — | |
| Iso-CTSBackbone=ViT-L/14, Number of tasks merged=4, Method Category=Data-Free Methods2025.08 | 70.2 | — | |
| Model SoupsBackbone=ViT-L/14, Number of tasks merged=12, Method Category=Data-Free Methods2025.08 | 70.1 | — | |
| TIES-MergingBackbone=ViT-L/14, Number of tasks merged=8, Method Category=Data-Free Methods2025.08 | 70 | — | |
| Model SoupsBackbone=ViT-L/14, Number of tasks merged=8, Method Category=Data-Free Methods2025.08 | 69.8 | — | |
| TIES-MergingBackbone=ViT-L/14, Number of tasks merged=4, Method Category=Data-Free Methods2025.08 | 69.6 | — | |
| Layer-wise AdaMergingBackbone=ViT-L/14, Number of tasks merged=4, Method Category=Test-Time Adaption Methods2025.08 | 69.6 | — | |
| Model SoupsBackbone=ViT-L/14, Number of tasks merged=4, Method Category=Data-Free Methods2025.08 | 69.4 | — | |
| Task ArithmeticBackbone=ViT-L/14, Number of tasks merged=12, Method Category=Data-Free Methods2025.08 | 69.4 | — | |
| Task ArithmeticBackbone=ViT-L/14, Number of tasks merged=20, Method Category=Data-Free Methods2025.08 | 69.3 | — | |
| Weight AveragingBackbone=ViT-B-162025.04 | 69.2 | 75.3 | |
| Model SoupsBackbone=ViT-L/14, Number of tasks merged=16, Method Category=Data-Free Methods2025.08 | 69.2 | — | |
| Task ArithmeticBackbone=ViT-L/14, Number of tasks merged=4, Method Category=Data-Free Methods2025.08 | 69.2 | — | |
| TIES-MergingBackbone=ViT-L/14, Number of tasks merged=16, Method Category=Data-Free Methods2025.08 | 69.2 | — | |
| RegMeanBackbone=ViT-L/14, Number of tasks merged=4, Method Category=Training-Free Methods2025.08 | 69.1 | — | |
| Task ArithmeticBackbone=ViT-B-162025.04 | 69 | 75 | |
| Task ArithmeticBackbone=ViT-L/14, Number of tasks merged=8, Method Category=Data-Free Methods2025.08 | 68.9 | — | |
| RegMean++Backbone=ViT-L/14, Number of tasks merged=4, Method Category=Training-Free Methods2025.08 | 68.9 | — | |
| Consensus TABackbone=ViT-B-322025.04 | 68.5 | 76.8 | |
| TSV-MBackbone=ViT-L/14, Number of tasks merged=4, Method Category=Data-Free Methods2025.08 | 68.4 | — | |
| Task ArithmeticBackbone=ViT-L/14, Number of tasks merged=16, Method Category=Data-Free Methods2025.08 | 68.3 | — | |
| WeMoEBackbone=ViT-B-322025.04 | 68.2 | 76.3 | |
| ZeroshotBackbone=ViT-L-142025.04 | 68.2 | 72.7 | |
| Fisher MergingBackbone=ViT-L/14, Number of tasks merged=20, Method Category=Training-Free Methods2025.08 | 68.2 | — | |
| Fisher MergingBackbone=ViT-L/14, Number of tasks merged=8, Method Category=Training-Free Methods2025.08 | 68.1 | — | |
| Fisher MergingBackbone=ViT-L/14, Number of tasks merged=16, Method Category=Training-Free Methods2025.08 | 68 | — | |
| DOGE AMBackbone=ViT-L/14, Number of tasks merged=4, Method Category=Test-Time Adaption Methods2025.08 | 67.8 | — | |
| Fisher MergingBackbone=ViT-L/14, Number of tasks merged=12, Method Category=Training-Free Methods2025.08 | 67.6 | — | |
| Fisher MergingBackbone=ViT-L/14, Number of tasks merged=4, Method Category=Training-Free Methods2025.08 | 66.7 | — | |
| WeMoEBackbone=ViT-B-162025.04 | 65 | 70.5 | |
| WeMoEBackbone=ViT-L-142025.04 | 65 | 69.4 | |
| Weight AveragingBackbone=ViT-B-322025.04 | 64.4 | 72.6 | |
| Task ArithmeticBackbone=ViT-B-322025.04 | 64 | 71.9 | |
| Iso-CBackbone=ViT-L/14, Number of tasks merged=16, Method Category=Data-Free Methods2025.08 | 63.4 | — | |
| ZeroshotBackbone=ViT-B-162025.04 | 62.5 | 68.3 | |
| ZeroshotBackbone=ViT-B-322025.04 | 57.5 | 65.2 | |
| Iso-CTSBackbone=ViT-L/14, Number of tasks merged=12, Method Category=Data-Free Methods2025.08 | 55.8 | — | |
| Iso-CBackbone=ViT-L/14, Number of tasks merged=20, Method Category=Data-Free Methods2025.08 | 45.7 | — | |
| Iso-CTSBackbone=ViT-L/14, Number of tasks merged=16, Method Category=Data-Free Methods2025.08 | 28.5 | — | |
| Iso-CTSBackbone=ViT-L/14, Number of tasks merged=20, Method Category=Data-Free Methods2025.08 | 13.8 | — |