Image Classification on SUN397 (Accuracy, ∆CA, ASR)
84.86AccuracyIndividual
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| IndividualBackbone=ViT-L/142026.04 | 84.86 | — | — | |
| Auto-FlexSwitch+KL (λ = 0.3)Type=Dynamic, Storage (MB)=80.69, Backbone=ViT-L/142026.04 | 84.86 | — | — | |
| Auto-FlexSwitch+MSE (λ = 0.05)Type=Dynamic, Storage (MB)=98.41, Backbone=ViT-L/142026.04 | 84.64 | — | — | |
| Auto-FlexSwitch+CKA (λ = 3)Type=Dynamic, Storage (MB)=89.76, Backbone=ViT-L/142026.04 | 84.55 | — | — | |
| EMR-MergingType=Dynamic, Storage (MB)=1633.46, Backbone=ViT-L/142026.04 | 83.17 | — | — | |
| Auto-SwitchType=Dynamic, Storage (MB)=556.88, Backbone=ViT-L/142026.04 | 83.17 | — | — | |
| MoW-MergingType=Dynamic, Storage (MB)=5159.51, Backbone=ViT-L/142026.04 | 80.99 | — | — | |
| Twin-MergingType=Dynamic, Storage (MB)=1780.62, Backbone=ViT-L/142026.04 | 80.22 | — | — | |
| Traditional MTLBackbone=ViT-L/142026.04 | 78.37 | — | — | |
| AdaMerging++Type=Static, Backbone=ViT-L/142026.04 | 77.48 | — | — | |
| AdaMergingType=Static, Backbone=ViT-L/142026.04 | 77.1 | — | — | |
| Task-ArithmeticType=Static, Backbone=ViT-L/142026.04 | 73.9 | — | — | |
| RegMeanType=Static, Backbone=ViT-L/142026.04 | 73.74 | — | — | |
| Ties-MergingType=Static, Backbone=ViT-L/142026.04 | 73.55 | — | — | |
| FedHPronumber of clients (K)=100, active ratio=20%2026.05 | 73.41 | — | — | |
| DAREType=Static, Backbone=ViT-L/142026.04 | 72.96 | — | — | |
| Weight-AveragingType=Static, Backbone=ViT-L/142026.04 | 71.08 | — | — | |
| FedSA†number of clients (K)=100, active ratio=20%2026.05 | 70.86 | — | — | |
| MaPLe + OursTest-time prompt tuning=True2026.04 | 70.32 | — | — | |
| OursTest-time prompt tuning=True2026.04 | 70.28 | — | — | |
| FedRCLnumber of clients (K)=100, active ratio=20%2026.05 | 70.23 | — | — | |
| Fisher MergingType=Static, Backbone=ViT-L/142026.04 | 70.16 | — | — | |
| FedAvgnumber of clients (K)=100, active ratio=20%2026.05 | 68.92 | — | — | |
| DF-MergeType=Static, Backbone=ViT-L/142026.04 | 68.21 | — | — | |
| Pre-trainedBackbone=ViT-L/142026.04 | 66.87 | — | — | |
| RN50 BaselineIR=37.7, Backbone=ResNet-502026.01 | 66.1 | — | — | |
| VLM BaselineIR=37.7, Backbone=VLM2026.01 | 62.2 | — | — | |
| FedSAnumber of clients (K)=100, active ratio=20%2026.05 | 61.58 | — | — | |
| PRISMIR=37.7, Attack Type=Blend, Backbone=ResNet-502026.01 | — | -1.2 | 2 | |
| PRISMIR=37.7, Attack Type=BPP, Backbone=ResNet-502026.01 | — | -1.2 | 0 | |
| PRISMIR=37.7, Attack Type=CTRL, Backbone=ResNet-502026.01 | — | -2.1 | 0 |