Model Merging on Large-scale tasks (2, 4, 8, 12, 16, 20 tasks merged)
98.2Average Normalized AccuracyDOGE AM
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| DOGE AMBackbone=ViT-B/16, Method Category=Test-Time Adaption Methods2025.08 | 98.2 | — | — | — | — | — | — | |
| TSV-MBackbone=ViT-B/16, Method Category=Data-Free Methods2025.08 | 97 | — | — | — | — | — | — | |
| Iso-CTSBackbone=ViT-B/16, Method Category=Data-Free Methods2025.08 | 96.7 | — | — | — | — | — | — | |
| RegMean++Backbone=ViT-B/16, Method Category=Training-Free Methods2025.08 | 96.5 | — | — | — | — | — | — | |
| Iso-CBackbone=ViT-B/16, Method Category=Data-Free Methods2025.08 | 96.4 | — | — | — | — | — | — | |
| Layer-wise AdaMergingBackbone=ViT-B/16, Method Category=Test-Time Adaption Methods2025.08 | 96.3 | — | — | — | — | — | — | |
| RegMeanBackbone=ViT-B/16, Method Category=Training-Free Methods2025.08 | 96.2 | — | — | — | — | — | — | |
| Iso-CTSBackbone=ViT-B/16, Method Category=Data-Free Methods2025.08 | 95.5 | — | — | — | — | — | — | |
| DOGE AMBackbone=ViT-B/16, Method Category=Test-Time Adaption Methods2025.08 | 95.4 | — | — | — | — | — | — | |
| DOGE TABackbone=ViT-B/16, Method Category=Data-Free Methods2025.08 | 95.3 | — | — | — | — | — | — | |
| Iso-CBackbone=ViT-B/16, Method Category=Data-Free Methods2025.08 | 95 | — | — | — | — | — | — | |
| RegMean++Backbone=ViT-B/16, Method Category=Training-Free Methods2025.08 | 94.1 | — | — | — | — | — | — | |
| TSV-MBackbone=ViT-B/16, Method Category=Data-Free Methods2025.08 | 94 | — | — | — | — | — | — | |
| RegMeanBackbone=ViT-B/16, Method Category=Training-Free Methods2025.08 | 92.9 | — | — | — | — | — | — | |
| Layer-wise AdaMergingBackbone=ViT-B/16, Method Category=Test-Time Adaption Methods2025.08 | 91.7 | — | — | — | — | — | — | |
| DOGE TABackbone=ViT-B/16, Method Category=Data-Free Methods2025.08 | 91.3 | — | — | — | — | — | — | |
| Task ArithmeticBackbone=ViT-B/16, Method Category=Data-Free Methods2025.08 | 90.8 | — | — | — | — | — | — | |
| Model SoupsBackbone=ViT-B/16, Method Category=Data-Free Methods2025.08 | 89.6 | — | — | — | — | — | — | |
| TIES-MergingBackbone=ViT-B/16, Method Category=Data-Free Methods2025.08 | 87.7 | — | — | — | — | — | — | |
| Fisher MergingBackbone=ViT-B/16, Method Category=Training-Free Methods2025.08 | 87.7 | — | — | — | — | — | — | |
| DOGE AMBackbone=ViT-B/16, Method Category=Test-Time Adaption Methods2025.08 | 86.9 | — | — | — | — | — | — | |
| TSV-MBackbone=ViT-B/16, Method Category=Data-Free Methods2025.08 | 85.4 | — | — | — | — | — | — | |
| Iso-CTSBackbone=ViT-B/16, Method Category=Data-Free Methods2025.08 | 84.6 | — | — | — | — | — | — | |
| TIES-MergingBackbone=ViT-B/16, Method Category=Data-Free Methods2025.08 | 83.8 | — | — | — | — | — | — | |
| RegMean++Backbone=ViT-B/16, Method Category=Training-Free Methods2025.08 | 83.7 | — | — | — | — | — | — | |
| Task ArithmeticBackbone=ViT-B/16, Method Category=Data-Free Methods2025.08 | 83.1 | — | — | — | — | — | — | |
| RegMeanBackbone=ViT-B/16, Method Category=Training-Free Methods2025.08 | 82.4 | — | — | — | — | — | — | |
| Fisher MergingBackbone=ViT-B/16, Method Category=Training-Free Methods2025.08 | 81.6 | — | — | — | — | — | — | |
| Iso-CBackbone=ViT-B/16, Method Category=Data-Free Methods2025.08 | 80.2 | — | — | — | — | — | — | |
| Layer-wise AdaMergingBackbone=ViT-B/16, Method Category=Test-Time Adaption Methods2025.08 | 79.2 | — | — | — | — | — | — | |
| Model SoupsBackbone=ViT-B/16, Method Category=Data-Free Methods2025.08 | 78.2 | — | — | — | — | — | — | |
| Fisher MergingBackbone=ViT-B/16, Method Category=Training-Free Methods2025.08 | 73.5 | — | — | — | — | — | — | |
| Model SoupsBackbone=ViT-B/16, Method Category=Data-Free Methods2025.08 | 71 | — | — | — | — | — | — | |
| DOGE TABackbone=ViT-B/16, Method Category=Data-Free Methods2025.08 | 70.9 | — | — | — | — | — | — | |
| TIES-MergingBackbone=ViT-B/16, Method Category=Data-Free Methods2025.08 | 66.3 | — | — | — | — | — | — | |
| Task ArithmeticBackbone=ViT-B/16, Method Category=Data-Free Methods2025.08 | 43.6 | — | — | — | — | — | — | |
| DOGE AMBackbone=ViT-L/14, Method Category=Test-Time Adaption Methods2025.08 | — | 99.9 | 98.9 | 98 | 97.6 | 96.8 | 92.4 | |
| DOGE TABackbone=ViT-L/14, Method Category=Data-Free Methods2025.08 | — | 98.6 | 96.8 | 93.8 | 91.9 | 89.7 | 79.4 | |
| Fisher MergingBackbone=ViT-L/14, Method Category=Training-Free Methods2025.08 | — | 98.4 | 91.4 | 87 | 83.1 | 82.2 | 74.6 | |
| Iso-CBackbone=ViT-L/14, Method Category=Data-Free Methods2025.08 | — | 98.5 | 98.5 | 97.6 | 96.6 | 93.9 | 88.5 | |
| Iso-CTSBackbone=ViT-L/14, Method Category=Data-Free Methods2025.08 | — | 99.1 | 98.9 | 98.3 | 96.8 | 95.5 | 92 | |
| Layer-wise AdaMergingBackbone=ViT-L/14, Method Category=Test-Time Adaption Methods2025.08 | — | 99.5 | 98.1 | 96.5 | 93.3 | 93.7 | 84.9 | |
| Model SoupsBackbone=ViT-L/14, Method Category=Data-Free Methods2025.08 | — | 97.8 | 93.2 | 84.5 | 81.8 | 84 | 76.1 | |
| RegMeanBackbone=ViT-L/14, Method Category=Training-Free Methods2025.08 | — | 99.3 | 97.7 | 95.7 | 94.5 | 93.7 | 86.9 | |
| RegMean++Backbone=ViT-L/14, Method Category=Training-Free Methods2025.08 | — | 99.3 | 97.8 | 96.3 | 94.3 | 93.8 | 88 | |
| Task ArithmeticBackbone=ViT-L/14, Method Category=Data-Free Methods2025.08 | — | 94.2 | 93.9 | 85 | 74.7 | 60 | 38.6 | |
| TIES-MergingBackbone=ViT-L/14, Method Category=Data-Free Methods2025.08 | — | 91.2 | 92.1 | 88.7 | 85.1 | 80.9 | 67.4 | |
| TSV-MBackbone=ViT-L/14, Method Category=Data-Free Methods2025.08 | — | 99.5 | 98 | 95.9 | 95 | 94.1 | 88.9 |