Image Classification on Vision Multi-task Suite (SUN397, Cars, RESISC45, EuroSAT, SVHN, GTSRB, MNIST, DTD)
95.8Average AccuracyFine-tuned
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Fine-tunedBackbone=ViT-L/142026.02 | 95.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| ESMBackbone=ViT-L/142026.02 | 94.8 | — | — | — | — | — | — | — | — | — | — | 98.9 | — | |
| Iso-CTSBackbone=ViT-L/142026.02 | 94.7 | — | — | — | — | — | — | — | — | — | — | 98.8 | — | |
| Fine-tunedBackbone=ViT-B/162026.02 | 94.6 | — | — | — | — | — | — | — | — | — | — | — | — | |
| IndividualBackbone=ViT-L/142025.12 | 94.25 | 81.72 | 92.39 | 98.85 | 99.88 | 98.11 | 99.24 | 99.69 | 84.15 | — | — | — | — | |
| DTS-DBackbone=ViT-L/142025.12 | 94.24 | 81.75 | 92.09 | 98.89 | 99.88 | 98.27 | 99.25 | 99.72 | 84.15 | 0.02 | 2.95 | — | — | |
| Iso-CBackbone=ViT-L/142026.02 | 94.2 | — | — | — | — | — | — | — | — | — | — | 98.3 | — | |
| DTS-TBackbone=ViT-L/142025.12 | 94.18 | 81.82 | 91.93 | 98.82 | 99.9 | 98.05 | 99.21 | 99.77 | 83.93 | 0.08 | 2.95 | — | — | |
| T-SwitchBackbone=ViT-L/142025.12 | 94.16 | 81.84 | 92.38 | 98.89 | 99.74 | 98.03 | 99.08 | 99.63 | 83.72 | 0.1 | 6.25 | — | — | |
| DTS-T*Backbone=ViT-L/14, config_variant=Low Memory2025.12 | 94.16 | 81.72 | 92.17 | 98.83 | 99.82 | 98.03 | 99.15 | 99.71 | 83.87 | 0.1 | 0.99 | — | — | |
| DTS-D*Backbone=ViT-L/14, config_variant=Low Memory2025.12 | 94.14 | 81.69 | 91.73 | 98.77 | 99.86 | 98.15 | 99.22 | 99.72 | 83.99 | 0.12 | 0.99 | — | — | |
| IndividualBackbone=CLIP-ViT-L/142023.12 | 94.1 | 82.3 | 92.4 | 97.4 | 99.9 | 98.1 | 99.2 | 99.7 | 84.1 | — | — | — | — | |
| TALL-MaskBackbone=ViT-L/142025.12 | 93.85 | 80.58 | 91.61 | 98.68 | 99.76 | 98.08 | 99.24 | 99.74 | 83.14 | 0.42 | 15.62 | — | — | |
| FREE-MergingBackbone=ViT-L/142025.12 | 93.65 | 81.6 | 92.03 | 96.54 | 99.61 | 98.1 | 98.79 | 99.72 | 82.8 | 0.63 | 10 | — | — | |
| WEMOEBackbone=ViT-L/142025.12 | 93.6 | 81.42 | 92.1 | 95.46 | 99.48 | 97.73 | 99.13 | 99.7 | 83.74 | 0.7 | 58.8 | — | — | |
| EMR-MergingBackbone=ViT-L/142025.12 | 93.59 | 80.47 | 90.71 | 98.55 | 99.54 | 97.94 | 99.1 | 99.69 | 82.71 | 0.71 | 15.62 | — | — | |
| Traditional MTLBackbone=CLIP-ViT-L/142023.12 | 93.5 | 80.8 | 90.6 | 96.3 | 96.3 | 97.6 | 99.1 | 99.6 | 84.4 | — | — | — | — | |
| SVDBackbone=ViT-L/142025.12 | 93.09 | 78.49 | 89.73 | 98.02 | 99.86 | 98.08 | 98.91 | 99.71 | 81.91 | 1.23 | 4.08 | — | — | |
| Twin-MergingBackbone=ViT-L/142025.12 | 93.01 | 81.92 | 91.59 | 96.87 | 99.72 | 98.03 | 92.42 | 99.57 | 83.94 | 1.31 | 100 | — | — | |
| TSV-MBackbone=ViT-L/142026.02 | 93 | — | — | — | — | — | — | — | — | — | — | 97 | — | |
| IndividualMerging Protocol=Non-merging, Backbone=CLIP ViT-B/162026.05 | 92.9 | 81.8 | 86.8 | 96.9 | 99.7 | 97.8 | 99.1 | 99.7 | 82 | — | — | — | — | |
| Fine-tunedBackbone=ViT-B/322026.02 | 92.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Concrete TSV-MBackbone=CLIP-ViT-L/142023.12 | 92.2 | 78.6 | 91.2 | 94.8 | 98.9 | 96.5 | 97.9 | 99.5 | 80.3 | — | — | — | — | |
| ESMBackbone=ViT-B/162026.02 | 91.8 | — | — | — | — | — | — | — | — | — | — | 97 | — | |
| TSV-MBackbone=CLIP-ViT-L/142023.12 | 91.3 | 78.3 | 89.9 | 94 | 98.5 | 95.3 | 96.2 | 99.5 | 79.1 | — | — | — | — | |
| Iso-CTSBackbone=ViT-B/162026.02 | 91.1 | — | — | — | — | — | — | — | — | — | — | 96.1 | — | |
| LW Concrete AMBackbone=CLIP-ViT-L/142023.12 | 91.1 | 77.8 | 91.2 | 92.1 | 97 | 94.4 | 97.9 | 99 | 79.5 | — | — | — | — | |
| AdaMerging++Backbone=ViT-L/142025.12 | 91.02 | 79.46 | 90.38 | 91.66 | 97.47 | 93.42 | 97.55 | 99.05 | 79.2 | 3.43 | 0 | — | — | |
| LW AM++Backbone=CLIP-ViT-L/142023.12 | 91 | 79.4 | 90.3 | 91.6 | 97.4 | 93.4 | 97.5 | 99 | 79.2 | — | — | — | — | |
| AdaMergingBackbone=ViT-L/142025.12 | 90.87 | 79.03 | 90.34 | 90.86 | 96.19 | 93.44 | 98.05 | 99.12 | 79.94 | 3.59 | 0 | — | — | |
| IndividualBackbone=ViT-B/32, Merging Regime=Non-merging2025.11 | 90.8 | 79.2 | 77.7 | 96.1 | 99.7 | 97.5 | 98.7 | 99.7 | 79.4 | — | — | — | — | |
| LW AMBackbone=CLIP-ViT-L/142023.12 | 90.8 | 79 | 90.3 | 90.8 | 96.2 | 93.4 | 98 | 99 | 79.9 | — | — | — | — | |
| Iso-CBackbone=ViT-B/162026.02 | 90.6 | — | — | — | — | — | — | — | — | — | — | 95.6 | — | |
| IndividualBackbone=CLIP-ViT-B/322023.12 | 90.5 | 75.3 | 77.7 | 96.1 | 99.9 | 97.5 | 98.7 | 99.7 | 79.4 | — | — | — | — | |
| SA-MergingMerging Protocol=Data-free model merging, Backbone=CLIP ViT-B/162026.05 | 89.8 | 76.8 | 83.5 | 92 | 98.2 | 95.8 | 97 | 99.5 | 76 | — | — | — | — | |
| DF-MergeMerging Protocol=Test-time / data-assisted, Backbone=CLIP ViT-B/162026.05 | 89.6 | 76 | 83 | 91.2 | 98.1 | 95.8 | 96.8 | 99.5 | 76 | — | — | — | — | |
| WUDI-MergingMerging Protocol=Data-free model merging, Backbone=CLIP ViT-B/162026.05 | 89.1 | 75.7 | 82.5 | 90.7 | 98 | 95.4 | 96.6 | 99.4 | 74.7 | — | — | — | — | |
| TSV-MBackbone=ViT-B/162026.02 | 89 | — | — | — | — | — | — | — | — | — | — | 93.9 | — | |
| Traditional MTLBackbone=ViT-B/32, Merging Regime=Non-merging2025.11 | 88.9 | 73.9 | 74.4 | 93.9 | 98.2 | 95.8 | 98.9 | 99.5 | 77.9 | — | — | — | — | |
| Traditional MTLBackbone=CLIP-ViT-B/322023.12 | 88.9 | 73.9 | 74.4 | 93.9 | 98.2 | 95.8 | 98.9 | 99.5 | 77.9 | — | — | — | — | |
| MDA AMBackbone=ViT-B/32, Merging Regime=Data-based2025.11 | 88.6 | 70 | 72 | 89.1 | 97.6 | 93.7 | 95.1 | 99.4 | 91.8 | — | — | — | — | |
| ESMBackbone=ViT-B/322026.02 | 88.4 | — | — | — | — | — | — | — | — | — | — | 95.3 | — | |
| Concrete TABackbone=CLIP-ViT-L/142023.12 | 87.4 | 74.6 | 86.2 | 89 | 96.7 | 93.6 | 93.4 | 99.1 | 66.9 | — | — | — | — | |
| TSV AMBackbone=ViT-B/32, Merging Regime=Data-based2025.11 | 87.3 | 68.1 | 72.1 | 87.7 | 96.4 | 92.3 | 93.3 | 99.4 | 88.9 | — | — | — | — | |
| TIES-MergingBackbone=ViT-L/142026.02 | 86.9 | — | — | — | — | — | — | — | — | — | — | 90.7 | — | |
| AdaMergingBackbone=CLIP/ViT-B-32, Fine-tuning protocol=LoRA rank 162026.03 | 86.8 | 90.8 | 90.1 | 85.6 | 87.8 | 82.8 | 86 | 94.7 | 76.8 | — | — | — | — | |
| FinetunedBackbone=CLIP/ViT-B-32, Fine-tuning protocol=Standard2026.03 | 86.6 | 72 | 70.7 | 91.6 | 98.5 | 95.7 | 97.6 | 99.4 | 67.6 | — | — | — | — | |
| MDA TABackbone=ViT-B/32, Merging Regime=Data-free2025.11 | 86.4 | 70.4 | 71.9 | 88.9 | 96.7 | 94.3 | 95.4 | 85.3 | 88.6 | — | — | — | — | |
| Iso-CBackbone=ViT-B/322026.02 | 86.3 | — | — | — | — | — | — | — | — | — | — | 92.9 | — | |
| Consensus TABackbone=ViT-L/142026.02 | 86.3 | — | — | — | — | — | — | — | — | — | — | 90.1 | — | |
| Iso-CTSBackbone=ViT-B/322026.02 | 86.2 | — | — | — | — | — | — | — | — | — | — | 92.8 | — | |
| DOGE AMBackbone=ViT-B/32, Merging Regime=Data-based2025.11 | 85.9 | 70.5 | 74.8 | 88.7 | 94.1 | 91.6 | 95.7 | 98.8 | 72.5 | — | — | — | — | |
| TSV-MBackbone=ViT-B/322026.02 | 85.9 | — | — | — | — | — | — | — | — | — | — | 92.3 | — | |
| TSV TABackbone=ViT-B/32, Merging Regime=Data-free2025.11 | 85.2 | 67.7 | 70.8 | 87.3 | 95.9 | 93.6 | 94.9 | 84.7 | 86.9 | — | — | — | — | |
| Task ArithmeticBackbone=ViT-L/142026.02 | 84.9 | — | — | — | — | — | — | — | — | — | — | 88.7 | — | |
| AdaMerging++Merging Protocol=Test-time / data-assisted, Backbone=CLIP ViT-B/162026.05 | 84.9 | 70.2 | 80.7 | 81.6 | 94.8 | 91.6 | 95.8 | 98.5 | 66.2 | — | — | — | — | |
| Rep. SurgeryMerging Protocol=Test-time / data-assisted, Backbone=CLIP ViT-B/162026.05 | 84.9 | 68.3 | 72.3 | 88.7 | 97.7 | 91 | 89.5 | 98.9 | 72.9 | — | — | — | — | |
| Concrete TSV-MBackbone=CLIP-ViT-B/322023.12 | 84.8 | 67.3 | 71.1 | 88.2 | 98 | 94.7 | 95 | 99.2 | 64.9 | — | — | — | — | |
| NSCBackbone=CLIP/ViT-B-32, Fine-tuning protocol=LoRA rank 162026.03 | 84.6 | 92.1 | 89.4 | 82.6 | 80.3 | 86 | 74.4 | 93.4 | 78.7 | — | — | — | — | |
| Ties-MergingBackbone=ViT-L/142025.12 | 84.56 | 74.74 | 84.5 | 89 | 94.18 | 85.66 | 82.07 | 98.65 | 67.71 | 10.28 | 0 | — | — | |
| Ties-MergingBackbone=CLIP-ViT-L/142023.12 | 84.5 | 75 | 84.5 | 88 | 94.3 | 85.7 | 82.1 | 98.7 | 67.7 | — | — | — | — | |
| Task-ArithmeticBackbone=ViT-L/142025.12 | 84.47 | 73.92 | 82.13 | 87.64 | 92.82 | 87.91 | 86.77 | 98.94 | 65.64 | 10.38 | 0 | — | — | |
| Task ArithmeticBackbone=CLIP-ViT-L/142023.12 | 84.4 | 74.1 | 82.1 | 86.7 | 92.6 | 87.9 | 86.8 | 98.9 | 65.6 | — | — | — | — | |
| Individual TaskBackbone=ViT-B/32, Protocol=Fine-tuned on single tasks2026.04 | 84.05 | 64.5 | 74 | 88.4 | 99 | 96.2 | 92.7 | 99.3 | 58.3 | — | — | — | — | |
| Concrete AMBackbone=ViT-B/32, Merging Regime=Data-based2025.11 | 84 | 67.8 | 70 | 87.5 | 96 | 91.6 | 96.7 | 98.7 | 63.8 | — | — | — | — | |
| LW Concrete AMBackbone=CLIP-ViT-B/322023.12 | 84 | 67.8 | 70 | 87.5 | 96 | 91.6 | 96.7 | 98.7 | 63.8 | — | — | — | — | |
| RegMeanBackbone=ViT-L/142025.12 | 83.76 | 73.38 | 81.8 | 86.1 | 97.01 | 88.12 | 84.27 | 98.54 | 60.82 | 11.14 | 0 | — | — | |
| RegMeanBackbone=CLIP-ViT-L/142023.12 | 83.7 | 73.3 | 81.8 | 86.1 | 97 | 88 | 84.2 | 98.5 | 60.8 | — | — | — | — | |
| DAREBackbone=ViT-L/142025.12 | 83.54 | 73.03 | 82.7 | 86.19 | 93.41 | 85.26 | 83.48 | 98.58 | 65.69 | 11.36 | 0 | — | — | |
| ISO TABackbone=ViT-B/32, Merging Regime=Data-free2025.11 | 82.9 | 72.1 | 73.8 | 88.5 | 91.3 | 81.4 | 90 | 80.1 | 86 | — | — | — | — | |
| AWD AMBackbone=ViT-B/32, Merging Regime=Data-based2025.11 | 82.9 | 68.1 | 71.4 | 83.4 | 94.8 | 87.7 | 93.6 | 97.9 | 66.1 | — | — | — | — | |
| TIESBackbone=CLIP/ViT-B-32, Fine-tuning protocol=LoRA rank 162026.03 | 82.9 | 92.5 | 90.6 | 81.2 | 78.8 | 82.5 | 66.1 | 91.6 | 80.4 | — | — | — | — | |
| Fisher-MergingBackbone=ViT-L/142025.12 | 82.22 | 69.24 | 88.61 | 87.5 | 93.53 | 80.66 | 74.82 | 93.32 | 70.07 | 12.77 | 0 | — | — | |
| Fisher MergingBackbone=CLIP-ViT-L/142023.12 | 82.2 | 69.2 | 88.6 | 87.5 | 93.5 | 80.6 | 74.8 | 93.3 | 70 | — | — | — | — | |
| TSV-MBackbone=CLIP-ViT-B/322023.12 | 81.2 | 64.6 | 68.7 | 80.5 | 91.1 | 90.9 | 90.6 | 99.1 | 64.5 | — | — | — | — | |
| AdaMerging++Backbone=ViT-B/32, Merging Regime=Data-based2025.11 | 81.1 | 66.6 | 68.3 | 82.2 | 94.2 | 89.6 | 89 | 98.3 | 60.6 | — | — | — | — | |
| TABackbone=CLIP/ViT-B-32, Fine-tuning protocol=LoRA rank 162026.03 | 81.1 | 92.4 | 87.8 | 78.8 | 62.9 | 85.9 | 70.5 | 92.2 | 78.6 | — | — | — | — | |
| LW AM++Backbone=CLIP-ViT-B/322023.12 | 81.1 | 66.6 | 68.3 | 82.2 | 94.2 | 89.6 | 89 | 98.3 | 60.6 | — | — | — | — | |
| Representation SurgeryBackbone=ViT-B/32, Merging Regime=Data-based2025.11 | 80.9 | 63.8 | 59.9 | 83.3 | 97.9 | 87 | 87 | 98.6 | 69.4 | — | — | — | — | |
| LW AMBackbone=CLIP-ViT-B/322023.12 | 80.9 | 64.2 | 69.5 | 82.4 | 92.5 | 86.5 | 93.7 | 97.7 | 61.1 | — | — | — | — | |
| ISO-CLS TABackbone=ViT-B/32, Merging Regime=Data-free2025.11 | 80.8 | 72.2 | 73.7 | 87.1 | 88.5 | 75.8 | 86.3 | 78.9 | 83.9 | — | — | — | — | |
| DOGE TABackbone=ViT-B/32, Merging Regime=Data-free2025.11 | 80.7 | 67.7 | 70.1 | 82 | 90.3 | 86.3 | 86.8 | 98.3 | 64 | — | — | — | — | |
| PCB MergingMerging Protocol=Data-free model merging, Backbone=CLIP ViT-B/162026.05 | 80.5 | 70.5 | 73 | 82 | 86 | 89 | 80 | 98.6 | 65 | — | — | — | — | |
| AdaMergingBackbone=ViT-B/32, Merging Regime=Data-based2025.11 | 80.1 | 64.5 | 68.1 | 79.2 | 93.8 | 87 | 91.9 | 97.5 | 59.1 | — | — | — | — | |
| TIES-MergingBackbone=ViT-B/162026.02 | 79.7 | — | — | — | — | — | — | — | — | — | — | 84.3 | — | |
| Weight-AveragingBackbone=ViT-L/142025.12 | 79.63 | 72.19 | 81.42 | 82.55 | 91.93 | 78.08 | 70.76 | 97.14 | 62.95 | 15.52 | 0 | — | — | |
| Weight AveragingBackbone=ViT-L/142026.02 | 79.6 | — | — | — | — | — | — | — | — | — | — | 83.2 | — | |
| Weight AveragingBackbone=CLIP-ViT-L/142023.12 | 79.5 | 72.1 | 81.6 | 82.6 | 91.4 | 78.2 | 70.6 | 97 | 62.8 | — | — | — | — | |
| Consensus TABackbone=ViT-B/162026.02 | 79.4 | — | — | — | — | — | — | — | — | — | — | 83.9 | — | |
| Unprotected Merged ModelMerging Method=LOT Merging, Defense Mechanism=None, Backbone=ViT-B/322026.06 | 79.16 | 66.96 | 65.7 | 75.65 | 92.8 | 92.65 | 82.98 | 98.85 | 57.66 | — | — | — | — | |
| AGAMerging Method=LOT Merging, Defense Mechanism=Params, Backbone=ViT-B/322026.06 | 78.48 | 66.98 | 65.27 | 73.26 | 92.38 | 91.43 | 82.88 | 98.42 | 57.18 | — | — | — | 72.99 | |
| AGAMerging Method=LOT Merging, Defense Mechanism=MergeLock, Backbone=ViT-B/322026.06 | 78.36 | 66.98 | 65.14 | 74.66 | 91.32 | 91.62 | 81.08 | 98.35 | 57.7 | — | — | — | 73.51 | |
| AGAMerging Method=LOT Merging, Defense Mechanism=Params-D, Backbone=ViT-B/322026.06 | 77.56 | 66.29 | 64.74 | 73.01 | 90.5 | 90.16 | 81.35 | 97.84 | 56.58 | — | — | — | 72.05 | |
| Concrete TABackbone=ViT-B/32, Merging Regime=Data-free2025.11 | 77.3 | 62.5 | 61.1 | 76 | 95.7 | 91 | 81.9 | 98.5 | 51.9 | — | — | — | — | |
| Concrete TABackbone=CLIP-ViT-B/322023.12 | 77.3 | 62.5 | 61.1 | 76 | 95.7 | 91 | 81.9 | 98.5 | 51.9 | — | — | — | — | |
| TIES-MergingMerging Protocol=Data-free model merging, Backbone=CLIP ViT-B/162026.05 | 77 | 69.1 | 72.5 | 80.5 | 84 | 85 | 71.5 | 98.1 | 54.9 | — | — | — | — | |
| RegMeanMerging Protocol=Data-free model merging, Backbone=CLIP ViT-B/162026.05 | 76.6 | 69.1 | 71.6 | 77.6 | 88.8 | 83.7 | 70.2 | 96.9 | 54.6 | — | — | — | — | |
| PCB-MergingBackbone=ViT-B/32, Merging Regime=Data-free2025.11 | 76.3 | 66.7 | 65.5 | 78.5 | 79.3 | 86.4 | 77.1 | 98.2 | 59.1 | — | — | — | — | |
| TW Concrete AMBackbone=CLIP-ViT-B/322023.12 | 76.2 | 62.7 | 58.9 | 74.5 | 94.8 | 91.1 | 95 | 98.1 | 34.6 | — | — | — | — | |
| AdaMergingMerging Protocol=Test-time / data-assisted, Backbone=CLIP ViT-B/162026.05 | 76 | 64.4 | 64.2 | 75.4 | 86.7 | 86.3 | 86.7 | 97.6 | 46.9 | — | — | — | — |