Image Classification on SUN397 (test)
95.94Top-1 AccuracyTransBoost
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| TransBoostEvaluation Protocol=Transductive, Resolution=224, Backbone=ResNet50, Classes=397, Train (+Validation) size=87,003, Test size=21,7502022.05 | 95.94 | 2.69 | — | — | |
| Supervised-INEvaluation Protocol=Fine-tuned2021.06 | 94.3 | — | — | — | |
| Standard InductiveEvaluation Protocol=Inductive, Resolution=224, Backbone=ResNet50, Classes=397, Train (+Validation) size=87,003, Test size=21,7502022.05 | 93.25 | — | — | — | |
| pFedVEMNumber of Clients=50, Model Type=Personalized2023.05 | 91.1 | — | — | — | |
| pFedMENumber of Clients=50, Model Type=Personalized2023.05 | 89.6 | — | — | — | |
| FedPerNumber of Clients=50, Model Type=Personalized2023.05 | 88.4 | — | — | — | |
| FedRepNumber of Clients=50, Model Type=Personalized2023.05 | 87.8 | — | — | — | |
| pFedVEMNumber of Clients=100, Model Type=Personalized2023.05 | 86.6 | — | — | — | |
| pFedVEMNumber of Clients=200, Model Type=Personalized2023.05 | 84.5 | — | — | — | |
| pFedBayesNumber of Clients=50, Model Type=Personalized2023.05 | 83.7 | — | — | — | |
| WiSE-FTalpha=optimal2021.09 | 83.3 | — | — | — | |
| WiSE-FTalpha=0.52021.09 | 83.2 | — | — | — | |
| pFedMENumber of Clients=200, Model Type=Personalized2023.05 | 82.9 | — | — | — | |
| pFedMENumber of Clients=100, Model Type=Personalized2023.05 | 82.8 | — | — | — | |
| LocalNumber of Clients=50, Model Type=Personalized2023.05 | 82.4 | — | — | — | |
| FedPerNumber of Clients=100, Model Type=Personalized2023.05 | 82.3 | — | — | — | |
| FedRepNumber of Clients=100, Model Type=Personalized2023.05 | 82.1 | — | — | — | |
| Standard fine-tuning2021.09 | 80.7 | — | — | — | |
| 2SFSBackbone=ViT-L/14, Shots=162025.03 | 80.3 | — | — | — | |
| FedPerNumber of Clients=200, Model Type=Personalized2023.05 | 80 | — | — | — | |
| FedRepNumber of Clients=200, Model Type=Personalized2023.05 | 79.6 | — | — | — | |
| pFedBayesNumber of Clients=100, Model Type=Personalized2023.05 | 77.4 | — | — | — | |
| DiDi-Merging-MBackbone=ViT-B/32, #Params=x1.4, Merging Strategy=Dynamic Merging2026.05 | 77.3 | — | — | — | |
| 2SFSBackbone=ViT-B/16, Shots=162025.03 | 77 | — | — | — | |
| TSV-CBackbone=ViT-B/32, #Params=x2.08, Merging Strategy=Dynamic Merging2026.05 | 77 | — | — | — | |
| DiDi-Merging-SBackbone=ViT-B/32, #Params=x1.24, Merging Strategy=Dynamic Merging2026.05 | 76.9 | — | — | — | |
| PerFedavgNumber of Clients=50, Model Type=Personalized2023.05 | 76.5 | — | — | — | |
| FREE-MergingBackbone=ViT-B/32, #Params=x2.16, Merging Strategy=Dynamic Merging2026.05 | 76.4 | — | — | — | |
| CLIP-LORABackbone=ViT-B/16, Shots=162025.03 | 76.1 | — | — | — | |
| TALL-Mask+TIESBackbone=ViT-B/32, #Params=x2.5, Merging Strategy=Dynamic Merging2026.05 | 75.8 | — | — | — | |
| IndividualsBackbone=ViT-B/32, #Params=x8, Merging Strategy=N/A2026.05 | 75.3 | — | — | — | |
| Fine-tuned (STL)Backbone=CLIP-ViT-B/32, Evaluation Protocol=Fine-tuned (STL)2026.05 | 75 | — | — | — | |
| CoOpBackbone=ViT-B/16, Shots=162025.03 | 74.9 | — | — | — | |
| 2SFSBackbone=ViT-B/32, Shots=162025.03 | 74.8 | — | — | — | |
| pFedBayesNumber of Clients=200, Model Type=Personalized2023.05 | 74.6 | — | — | — | |
| MultitaskBackbone=ViT-B/32, #Params=x1, Merging Strategy=N/A2026.05 | 74.4 | — | — | — | |
| ISO-CTSBackbone=ViT-B/32, #Params=x1, Merging Strategy=Static Merging2026.05 | 74.4 | — | — | — | |
| pFedVEMNumber of Clients=200, Model Type=Global2023.05 | 74.3 | — | — | — | |
| pFedVEMNumber of Clients=100, Model Type=Global2023.05 | 74.1 | — | — | — | |
| EMR-MergingBackbone=ViT-B/32, #Params=x4, Merging Strategy=Dynamic Merging2026.05 | 74.1 | — | — | — | |
| FedProxNumber of Clients=50, Model Type=Global2023.05 | 73.7 | — | — | — | |
| WEMoEBackbone=ViT-B/32, #Params=x6.27, Merging Strategy=Dynamic Merging2026.05 | 73.7 | — | — | — | |
| SMILEBackbone=ViT-B/32, #Params=x3.07, Merging Strategy=Dynamic Merging2026.05 | 73.6 | — | — | — | |
| Twin-MergingBackbone=ViT-B/32, #Params=x2.25, Merging Strategy=Dynamic Merging2026.05 | 73.6 | — | — | — | |
| PerFedavgNumber of Clients=100, Model Type=Personalized2023.05 | 73.5 | — | — | — | |
| FedProxNumber of Clients=100, Model Type=Global2023.05 | 73.3 | — | — | — | |
| pFedVEMNumber of Clients=50, Model Type=Global2023.05 | 73.3 | — | — | — | |
| FedAvgNumber of Clients=50, Model Type=Global2023.05 | 73.2 | — | — | — | |
| pFedMENumber of Clients=200, Model Type=Global2023.05 | 73 | — | — | — | |
| AdaMerging w/ FEATCALBackbone=CLIP-ViT-B/32, Upstream Merger=AdaMerging, Refinement=FEATCAL2026.05 | 73 | — | — | — | |
| FedAvgNumber of Clients=200, Model Type=Global2023.05 | 72.7 | — | — | — | |
| FedAvgNumber of Clients=100, Model Type=Global2023.05 | 72.6 | — | — | — | |
| IFCANumber of Clients=50, Model Type=Personalized2023.05 | 72.5 | — | — | — | |
| PerFedavgNumber of Clients=200, Model Type=Personalized2023.05 | 72.4 | — | — | — | |
| pFedMENumber of Clients=100, Model Type=Global2023.05 | 72.3 | — | — | — | |
| Traditional MTLBackbone=CLIP-ViT-B/32, Evaluation Protocol=Traditional MTL2026.05 | 72.3 | — | — | — | |
| pFedMENumber of Clients=50, Model Type=Global2023.05 | 72.2 | — | — | — | |
| WUDI-Merging w/ FEATCALBackbone=CLIP-ViT-B/32, Upstream Merger=WUDI-Merging, Refinement=FEATCAL2026.05 | 72.2 | — | — | — | |
| CLIP-B32 (LOES)Model=CLIP-B32, Selection Strategy=LOES2026.05 | 72.07 | — | — | — | |
| LocalNumber of Clients=100, Model Type=Personalized2023.05 | 72 | — | — | — | |
| DINOv2-S (LOES)Model=DINOv2-S, Selection Strategy=LOES2026.05 | 71.96 | — | — | — | |
| IFCANumber of Clients=100, Model Type=Personalized2023.05 | 71.5 | — | — | — | |
| WUDI-MergingBackbone=ViT-B/32, #Params=x1, Merging Strategy=Static Merging2026.05 | 71.1 | — | — | — | |
| FedProxNumber of Clients=200, Model Type=Global2023.05 | 70.8 | — | — | — | |
| DINOv3-S/16 (LOES)Model=DINOv3-S/16, Selection Strategy=LOES2026.05 | 70.61 | — | — | — | |
| AdaMerging w/ ProbSurgeryBackbone=CLIP-ViT-B/32, Upstream Merger=AdaMerging, Refinement=ProbSurgery2026.05 | 70.6 | — | — | — | |
| ComMemBackbone=ViT-B/162026.06 | 70.48 | — | — | — | |
| DMN-ZSBackbone=ViT-B/162026.06 | 70.18 | — | — | — | |
| Task Arithmetic w/ FEATCALBackbone=CLIP-ViT-B/32, Upstream Merger=Task Arithmetic, Refinement=FEATCAL2026.05 | 70.1 | — | — | — | |
| DPEBackbone=ViT-B/162026.06 | 70.07 | — | — | — | |
| TPSBackbone=ViT-B/162026.06 | 69.98 | — | — | — | |
| AdaMerging w/ SurgeryBackbone=CLIP-ViT-B/32, Upstream Merger=AdaMerging, Refinement=Surgery2026.05 | 69.8 | — | — | — | |
| Simple Averaging w/ FEATCALBackbone=CLIP-ViT-B/32, Upstream Merger=Simple Averaging, Refinement=FEATCAL2026.05 | 69.7 | — | — | — | |
| ScaffoldNumber of Clients=50, Model Type=Global2023.05 | 69.5 | — | — | — | |
| WUDI-Merging w/ ProbSurgeryBackbone=CLIP-ViT-B/32, Upstream Merger=WUDI-Merging, Refinement=ProbSurgery2026.05 | 69.5 | — | — | — | |
| ViT-IN21k-B/16 (LOES)Model=ViT-IN21k-B/16, Selection Strategy=LOES2026.05 | 69.47 | — | — | — | |
| Simple Averaging w/ ProbSurgeryBackbone=CLIP-ViT-B/32, Upstream Merger=Simple Averaging, Refinement=ProbSurgery2026.05 | 69.2 | — | — | — | |
| TSV-MergingBackbone=ViT-B/32, #Params=x1, Merging Strategy=Static Merging2026.05 | 69.1 | — | — | — | |
| WUDI-Merging w/ SurgeryBackbone=CLIP-ViT-B/32, Upstream Merger=WUDI-Merging, Refinement=Surgery2026.05 | 69 | — | — | — | |
| DINOv2-S (Last)Model=DINOv2-S, Selection Strategy=Last Layer2026.05 | 68.62 | — | — | — | |
| CAT-MergingBackbone=ViT-B/32, #Params=x1, Merging Strategy=Static Merging2026.05 | 68.1 | — | — | — | |
| IFCANumber of Clients=200, Model Type=Personalized2023.05 | 68 | — | — | — | |
| WUDI-MergingBackbone=CLIP-ViT-B/32, Upstream Merger=WUDI-Merging2026.05 | 68 | — | — | — | |
| AdaMergingBackbone=CLIP-ViT-B/32, Upstream Merger=AdaMerging2026.05 | 67.9 | — | — | — | |
| CoCoOp2023.09 | 67.73 | — | — | — | |
| TDABackbone=ViT-B/162026.06 | 67.62 | — | — | — | |
| LocalNumber of Clients=200, Model Type=Personalized2023.05 | 67.4 | — | — | — | |
| Simple Averaging w/ SurgeryBackbone=CLIP-ViT-B/32, Upstream Merger=Simple Averaging, Refinement=Surgery2026.05 | 67.4 | — | — | — | |
| DePTBaseline=CoCoOp2023.09 | 67.3 | — | — | — | |
| DePTBaseline=PromptSRC2023.09 | 67.23 | — | — | — | |
| HisTPTBackbone=ViT-B/16, Protocol=Continuous Test-time Prompt Tuning2024.10 | 67.2 | — | — | — | |
| Global DEPre-train=Self-supervised (SSL), Backbone=ResNet-50, Ensemble Size=52023.03 | 67.04 | — | — | — | |
| ViT-IN21k-B/16 (Last)Model=ViT-IN21k-B/16, Selection Strategy=Last Layer2026.05 | 66.99 | — | — | — | |
| PromptSRC2023.09 | 66.93 | — | — | — | |
| KgCoOp2023.09 | 66.83 | — | — | — | |
| DINOv3-S/16 (Last)Model=DINOv3-S/16, Selection Strategy=Last Layer2026.05 | 66.69 | — | — | — | |
| DePTBaseline=KgCoOp2023.09 | 66.67 | — | — | — | |
| DeiT-B/16 (LOES)Model=DeiT-B/16, Selection Strategy=LOES2026.05 | 66.46 | — | — | — | |
| DePTBaseline=MaPLe2023.09 | 66.4 | — | — | — | |
| StarSSE (opt.)Pre-train=Self-supervised (SSL), Backbone=ResNet-50, Ensemble Size=52023.03 | 66.37 | — | — | — |