Image Classification on 8-task vision suite (CLIP ViT-L/14, test)
82.3SUN397 AccuracyIndividual
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| IndividualBackbone=CLIP ViT-L/14, Merging Category=Non-merging2026.05 | 82.3 | 92.4 | 97.4 | 100 | 98.1 | 99.2 | 99.7 | 84.1 | 94.2 | |
| SA-MergingBackbone=CLIP ViT-L/14, Merging Category=Data-free model merging2026.05 | 82 | 91.8 | 95 | 99.4 | 97 | 98.6 | 99.7 | 83.5 | 93.4 | |
| WUDI-MergingBackbone=CLIP ViT-L/14, Merging Category=Data-free model merging2026.05 | 81 | 91 | 94.2 | 99.2 | 96.3 | 98.1 | 99.6 | 81.2 | 92.6 | |
| Traditional MTLBackbone=CLIP ViT-L/14, Merging Category=Non-merging2026.05 | 80.8 | 90.6 | 96.3 | 96.3 | 97.6 | 99.1 | 99.6 | 84.4 | 93.5 | |
| AdaMerging++Backbone=CLIP ViT-L/14, Merging Category=Test-time / data-assisted2026.05 | 79.4 | 90.3 | 91.6 | 97.4 | 93.4 | 97.5 | 99 | 79.2 | 91 | |
| AdaMergingBackbone=CLIP ViT-L/14, Merging Category=Test-time / data-assisted2026.05 | 79 | 90.3 | 90.8 | 96.2 | 93.4 | 98 | 99 | 79.9 | 90.8 | |
| PCB MergingBackbone=CLIP ViT-L/14, Merging Category=Data-free model merging2026.05 | 76.8 | 86.2 | 89.4 | 96.5 | 88.3 | 91 | 98.6 | 73.6 | 87.5 | |
| TIES-MergingBackbone=CLIP ViT-L/14, Merging Category=Data-free model merging2026.05 | 76.5 | 85 | 89.3 | 95.7 | 90.3 | 83.3 | 99 | 68.8 | 86 | |
| Rep. SurgeryBackbone=CLIP ViT-L/14, Merging Category=Test-time / data-assisted2026.05 | 75.7 | 84.4 | 93.1 | 98.8 | 91.3 | 93.4 | 99.1 | 76.1 | 89 | |
| Task ArithmeticBackbone=CLIP ViT-L/14, Merging Category=Data-free model merging2026.05 | 73.9 | 82.1 | 86.6 | 94.1 | 87.9 | 86.7 | 98.9 | 65.6 | 84.5 | |
| RegMeanBackbone=CLIP ViT-L/14, Merging Category=Data-free model merging2026.05 | 73.3 | 81.8 | 86.1 | 97 | 88 | 84.2 | 98.5 | 60.8 | 83.7 | |
| Weight Avg.Backbone=CLIP ViT-L/14, Merging Category=Data-free model merging2026.05 | 72.1 | 81.6 | 82.6 | 91.9 | 78.2 | 70.7 | 97.1 | 62.8 | 79.6 | |
| Fisher MergingBackbone=CLIP ViT-L/14, Merging Category=Data-free model merging2026.05 | 69.2 | 88.6 | 87.5 | 93.5 | 80.6 | 74.8 | 93.3 | 70 | 82.2 | |
| PretrainedBackbone=CLIP ViT-L/14, Merging Category=Non-merging2026.05 | 66.8 | 77.7 | 71 | 59.9 | 58.4 | 50.5 | 76.3 | 55.3 | 64.5 |