Image Classification on VisDA-C (test)
89.4Mean AccuracySPM
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SPMSource-Free=true, Backbone=ResNet-1012025.05 | 89.4 | 98.1 | 87.9 | 86.7 | 86.2 | 97.7 | 94.8 | 93.3 | 85.6 | 95.9 | 95.6 | 95.5 | 55.3 | — | |
| UPASource-Free=true, Backbone=ResNet-1012025.05 | 88.7 | 97 | 90.4 | 82.6 | 65 | 96.7 | 96.7 | 91 | 87 | 96.8 | 96.5 | 89.2 | 75 | — | |
| Improved SFDASource-Free=true, Backbone=ResNet-1012025.05 | 88.4 | 97.5 | 91.4 | 87.9 | 79.4 | 97.2 | 97.2 | 92.2 | 83 | 96.4 | 94.2 | 91.1 | 53 | — | |
| CDTransBackbone=DeiT-base2021.09 | 88.4 | 97.1 | 90.5 | 82.4 | 77.5 | 96.6 | 96.1 | 93.6 | 88.6 | 97.9 | 86.9 | 90.3 | 62.8 | — | |
| SF(DA)^2Source-Free=true, Backbone=ResNet-1012025.05 | 88.1 | 96.8 | 89.3 | 82.9 | 81.4 | 96.8 | 95.7 | 90.4 | 81.3 | 95.5 | 93.7 | 88.5 | 64.7 | — | |
| CANSource-Free=false, Backbone=ResNet-1012025.05 | 87.2 | 97 | 87.2 | 82.5 | 74.3 | 97.8 | 96.2 | 90.8 | 80.7 | 96.6 | 96.3 | 87.5 | 59.9 | — | |
| FixBiSource-Free=false, Backbone=ResNet-1012025.05 | 87.2 | 96.1 | 87.8 | 90.5 | 90.3 | 96.8 | 95.3 | 92.8 | 88.7 | 97.2 | 94.2 | 90.9 | 25.7 | — | |
| AdaContrastSource-Free=true, Backbone=ResNet-1012025.05 | 86.8 | 97 | 84.7 | 84 | 77.3 | 96.7 | 93.8 | 91.9 | 84.8 | 94.3 | 93.1 | 94.1 | 49.7 | — | |
| SHOT-B*Backbone=DeiT-base, reproduced=true2021.09 | 85.9 | 97.9 | 90.3 | 86 | 73.4 | 96.9 | 98.8 | 94.3 | 54.8 | 95.4 | 87.1 | 93.4 | 62.7 | — | |
| Ours w/ domain-IDBackbone=ResNet-101, Source-free=true, Evaluation Setting=G-SFDA, Domain-ID awareness=true2021.08 | 85 | 95.9 | 88.1 | 85.4 | 72.5 | 96.1 | 93.7 | 88.5 | 80.6 | 92.3 | 92.2 | 87.6 | 44.8 | — | |
| Ours w/o domain-IDBackbone=ResNet-101, Source-free=true, Evaluation Setting=G-SFDA, Domain-ID awareness=false2021.08 | 84.4 | 95.4 | 87.7 | 85.7 | 71.5 | 96.1 | 94.8 | 89.2 | 80.4 | 92 | 88.6 | 87.4 | 44.1 | — | |
| TVTBackbone=ResNet-101, pretraining=ImageNet21K2021.09 | 83.9 | 92.9 | 85.6 | 77.5 | 60.5 | 93.6 | 98.2 | 89.4 | 76.4 | 93.6 | 92 | 91.7 | 55.7 | — | |
| SHOTSource-Free=true, Backbone=ResNet-1012025.05 | 83 | 95.3 | 87.5 | 78.7 | 55.6 | 94.1 | 94.2 | 81.4 | 80 | 91.8 | 90.7 | 86.5 | 59.8 | — | |
| SHOTBackbone=ResNet-101, Evaluation Protocol=vanilla closed-set DA, Domain Scenario=Synthesis -> Real2020.02 | 82.9 | 94.3 | 88.5 | 80.1 | 57.3 | 93.1 | 94.9 | 80.7 | 80.3 | 91.5 | 89.1 | 86.3 | 58.2 | — | |
| SHOTBackbone=ResNet-1012021.09 | 82.9 | 94.3 | 88.5 | 80.1 | 57.3 | 93.1 | 93.1 | 80.7 | 80.3 | 91.5 | 89.1 | 86.3 | 58.2 | — | |
| BAITSource-Free=true, Backbone=ResNet-1012025.05 | 82.7 | 93.7 | 83.2 | 84.5 | 65 | 92.9 | 95.4 | 88.1 | 80.8 | 90 | 89 | 84 | 45.3 | — | |
| SHOTBackbone=ResNet-101, reproduced=true2021.09 | 82.7 | 95.5 | 87.5 | 80.1 | 54.5 | 93.6 | 94.2 | 80.2 | 80.9 | 90 | 89.9 | 87.1 | 58.4 | — | |
| CGDMBackbone=ResNet-1012021.09 | 82.3 | 93.7 | 82.7 | 73.2 | 68.4 | 92.9 | 94.5 | 88.7 | 82.1 | 93.4 | 82.5 | 86.8 | 49.2 | — | |
| CGDM-B*Backbone=DeiT-base, reproduced=true2021.09 | 82.3 | 96.3 | 87.1 | 86.8 | 83.5 | 92.2 | 98.3 | 91.6 | 78.5 | 96.3 | 48.4 | 89.4 | 39 | — | |
| SHOTBackbone=ResNet-101, Source-free=true, Evaluation Setting=G-SFDA2021.08 | 82.2 | 94.4 | 85.8 | 78.4 | 55.2 | 93.9 | 95 | 81.5 | 79.5 | 89.8 | 90.1 | 85.6 | 56.8 | — | |
| MASource-Free=true, Backbone=ResNet-1012025.05 | 81.6 | 94.8 | 73.4 | 68.8 | 74.8 | 93.1 | 95.4 | 88.6 | 84.7 | 89.1 | 84.7 | 83.5 | 48.1 | — | |
| DTABackbone=ResNet-101, Pre-trained=ImageNet2019.10 | 81.5 | 93.7 | 82.2 | 85.6 | 83.8 | 93 | 81 | 90.7 | 82.1 | 95.1 | 78.1 | 86.4 | 32.1 | — | |
| CGDMBackbone=ResNet-101, reproduced=true2021.09 | 80.8 | 92.8 | 85.1 | 76.3 | 64.5 | 91 | 93.2 | 81.3 | 79.3 | 92.4 | 83 | 85.6 | 44.8 | — | |
| SHOT-IMBackbone=ResNet-101, Evaluation Protocol=vanilla closed-set DA, Domain Scenario=Synthesis -> Real2020.02 | 80.4 | 93.7 | 86.4 | 78.7 | 50.7 | 91 | 93.5 | 79 | 78.3 | 89.2 | 85.4 | 87.9 | 51.1 | — | |
| MSTN+DSBNBackbone=ResNet-1012021.09 | 80.2 | 94.7 | 86.7 | 76 | 72 | 95.2 | 75.1 | 87.9 | 81.3 | 91.1 | 68.9 | 88.3 | 45.5 | — | |
| ADRBackbone=ResNeXt, retrain_classifier=true2017.11 | 79.6 | 94.6 | 82.6 | 84.4 | 73.3 | 94.2 | 83.4 | 92.2 | 76.1 | 91.5 | 55.1 | 85.2 | 43.2 | — | |
| ADRBackbone=ResNeXt, retrain_classifier=false2017.11 | 79.1 | 93.5 | 81.1 | 82.2 | 68.3 | 92 | 67.1 | 90.8 | 80.1 | 92.6 | 72.1 | 87.6 | 42 | — | |
| MCCSource-Free=false, Backbone=ResNet-1012025.05 | 78.8 | 88.7 | 80.3 | 80.5 | 71.5 | 90.1 | 93.2 | 85 | 71.6 | 89.4 | 73.8 | 85 | 36.9 | — | |
| SWDSource-Free=false, Backbone=ResNet-1012025.05 | 76.4 | 90.8 | 82.5 | 81.7 | 70.5 | 91.7 | 69.5 | 86.3 | 77.5 | 87.4 | 63.6 | 85.6 | 29.2 | — | |
| SWDBackbone=ResNet-101, Evaluation Protocol=vanilla closed-set DA, Domain Scenario=Synthesis -> Real2020.02 | 76.4 | 90.8 | 82.5 | 81.7 | 70.5 | 91.7 | 69.5 | 86.3 | 77.5 | 87.4 | 63.6 | 85.6 | 29.2 | — | |
| SWDBackbone=ResNet-1012021.09 | 76.4 | 90.8 | 82.5 | 81.7 | 70.5 | 91.7 | 69.5 | 86.3 | 77.5 | 87.4 | 63.6 | 85.6 | 29.2 | — | |
| SAFNBackbone=ResNet-101, Evaluation Protocol=vanilla closed-set DA, Domain Scenario=Synthesis -> Real2020.02 | 76.1 | 93.6 | 61.3 | 84.1 | 70.6 | 94.1 | 79 | 91.8 | 79.6 | 89.9 | 55.6 | 89 | 24.4 | — | |
| CDAN+BSPBackbone=ResNet-101, Evaluation Protocol=vanilla closed-set DA, Domain Scenario=Synthesis -> Real2020.02 | 75.9 | 92.4 | 61 | 81 | 57.5 | 89 | 80.6 | 90.1 | 77 | 84.2 | 77.9 | 82.1 | 38.4 | — | |
| ADRBackbone=ResNet101, retrain_classifier=true2017.11 | 74.8 | 87.8 | 79.5 | 83.7 | 65.3 | 92.3 | 61.8 | 88.9 | 73.2 | 87.8 | 60 | 85.5 | 32.3 | — | |
| ADRBackbone=ResNet-101, Pre-trained=ImageNet2019.10 | 74.8 | 87.8 | 79.5 | 83.7 | 65.3 | 92.3 | 61.8 | 88.9 | 73.2 | 87.8 | 60 | 85.5 | 32.3 | — | |
| CDANSource-Free=false, Backbone=ResNet-1012025.05 | 73.9 | 85.2 | 66.9 | 83 | 50.8 | 84.2 | 74.9 | 88.1 | 74.5 | 83.4 | 76 | 81.9 | 38 | — | |
| ADRBackbone=ResNet101, retrain_classifier=false2017.11 | 73.9 | 85.1 | 77.3 | 78.9 | 64 | 91.6 | 52.7 | 91.3 | 75.8 | 88.5 | 60.5 | 87.7 | 33.9 | — | |
| CDANBackbone=ResNet-101, Evaluation Protocol=vanilla closed-set DA, Domain Scenario=Synthesis -> Real2020.02 | 73.9 | 85.2 | 66.9 | 83 | 50.8 | 84.2 | 74.9 | 88.1 | 74.5 | 83.4 | 76 | 81.9 | 38 | — | |
| CDAN+EBackbone=ResNet-1012021.09 | 73.9 | 85.2 | 66.9 | 83 | 50.8 | 84.2 | 74.9 | 88.1 | 74.5 | 83.4 | 76 | 81.9 | 38 | — | |
| ADRBackbone=ResNet-101, Evaluation Protocol=vanilla closed-set DA, Domain Scenario=Synthesis -> Real2020.02 | 73.5 | 94.2 | 48.5 | 84 | 72.9 | 90.1 | 74.2 | 92.6 | 72.5 | 80.8 | 61.8 | 82.2 | 28.8 | — | |
| Generate To AdaptBackbone=ResNet-152, Adaptation Setting=Adapted2017.04 | 72.3 | — | — | — | — | — | — | — | — | — | — | — | — | 76.7 | |
| MCDBackbone=ResNet-101, Pre-trained=ImageNet2019.10 | 71.9 | 87 | 60.9 | 83.7 | 64 | 88.9 | 79.6 | 84.7 | 76.9 | 88.6 | 40.3 | 83 | 25.8 | — | |
| MCDBackbone=ResNet-1012021.09 | 71.9 | 87 | 60.9 | 83.7 | 64 | 88.9 | 79.6 | 84.7 | 76.9 | 88.6 | 40.3 | 83 | 25.8 | — | |
| SAFN+ENTBackbone=ResNet-50, Ten-crop evaluation=true2020.07 | 70.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BNMBackbone=ResNet-1012021.09 | 70.4 | 89.6 | 61.5 | 76.9 | 55 | 89.3 | 69.1 | 81.3 | 65.5 | 90 | 47.3 | 89.1 | 30.1 | — | |
| SAFNBackbone=ResNet-50, Ten-crop evaluation=false2020.07 | 67.65 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Baseline-BBackbone=DeiT-base2021.09 | 67.1 | 97.7 | 48.1 | 86.6 | 61.6 | 78.1 | 63.4 | 94.7 | 10.3 | 87.7 | 47.7 | 94.4 | 35.5 | — | |
| HAFNBackbone=ResNet-50, Ten-crop evaluation=false2020.07 | 65.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MMDBackbone=ResNeXt2017.11 | 63.7 | 90.7 | 51.1 | 64.8 | 65.6 | 89.9 | 46.5 | 91.9 | 40.1 | 81.5 | 24.1 | 90 | 28.5 | — | |
| MMDBackbone=ResNet1012017.11 | 61.1 | 87.1 | 63 | 76.5 | 42 | 90.3 | 42.9 | 85.9 | 53.1 | 49.7 | 36.3 | 85.8 | 20.7 | — | |
| DANBackbone=ResNet-101, Pre-trained=ImageNet2019.10 | 61.1 | 87.1 | 63 | 76.5 | 42 | 90.3 | 42.9 | 85.9 | 53.1 | 49.7 | 36.3 | 85.8 | 20.7 | — | |
| DANBackbone=ResNet-101, Evaluation Protocol=vanilla closed-set DA, Domain Scenario=Synthesis -> Real2020.02 | 61.1 | 87.1 | 63 | 76.5 | 42 | 90.3 | 42.9 | 85.9 | 53.1 | 49.7 | 36.3 | 85.8 | 20.7 | — | |
| DANNBackbone=ResNeXt2017.11 | 59.6 | 86 | 66.3 | 60.8 | 56 | 79.8 | 53.7 | 82.3 | 25.2 | 58.2 | 31 | 89.3 | 26.1 | — | |
| DRCNBackbone=ResNet-50, Ten-crop evaluation=true2020.07 | 58.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DANNSource-Free=false, Backbone=ResNet-1012025.05 | 57.4 | 81.9 | 77.7 | 82.8 | 44.3 | 81.2 | 29.5 | 65.1 | 28.6 | 51.9 | 54.6 | 82.8 | 7.8 | — | |
| DANNBackbone=ResNet1012017.11 | 57.4 | 81.9 | 77.7 | 82.8 | 44.3 | 81.2 | 29.5 | 65.1 | 28.6 | 51.9 | 54.6 | 82.8 | 7.8 | — | |
| DANNBackbone=ResNet-101, Pre-trained=ImageNet2019.10 | 57.4 | 81.9 | 77.7 | 82.8 | 44.3 | 81.2 | 29.5 | 65.1 | 28.6 | 51.9 | 54.6 | 82.8 | 7.8 | — | |
| DANNBackbone=ResNet-101, Evaluation Protocol=vanilla closed-set DA, Domain Scenario=Synthesis -> Real2020.02 | 57.4 | 81.9 | 77.7 | 82.8 | 44.3 | 81.2 | 29.5 | 65.1 | 28.6 | 51.9 | 54.6 | 82.8 | 7.8 | — | |
| DANNBackbone=ResNet-1012021.09 | 57.4 | 81.9 | 77.7 | 82.8 | 44.3 | 81.2 | 29.5 | 65.1 | 28.6 | 51.9 | 54.6 | 82.8 | 7.8 | — | |
| ENTBackbone=ResNet1012017.11 | 57 | 80.3 | 75.5 | 75.8 | 48.3 | 77.9 | 27.3 | 69.7 | 40.2 | 46.5 | 46.6 | 79.3 | 16 | — | |
| MinEntBackbone=ResNet-1012021.09 | 57 | 80.3 | 75.5 | 75.8 | 48.3 | 77.9 | 27.3 | 69.7 | 40.2 | 46.5 | 46.6 | 79.3 | 16 | — | |
| ENTBackbone=ResNeXt2017.11 | 56.6 | 94.7 | 81 | 57 | 46.6 | 73.9 | 49 | 69.2 | 31 | 40.5 | 34.3 | 87.3 | 15.1 | — | |
| PADABackbone=ResNet-50, Ten-crop evaluation=true2020.07 | 53.53 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Source OnlyBackbone=ResNet1012017.11 | 52.4 | 55.1 | 53.3 | 61.9 | 59.1 | 80.6 | 17.9 | 79.7 | 31.2 | 81 | 26.5 | 73.5 | 8.5 | — | |
| ResNet-101Backbone=ResNet-101, Evaluation Protocol=vanilla closed-set DA, Domain Scenario=Synthesis -> Real2020.02 | 52.4 | 55.1 | 53.3 | 61.9 | 59.1 | 80.6 | 17.9 | 79.7 | 31.2 | 81 | 26.5 | 73.5 | 8.5 | — | |
| ResNet-50Backbone=ResNet-502021.09 | 52.4 | 55.1 | 53.3 | 61.9 | 59.1 | 80.6 | 17.9 | 79.7 | 31.2 | 81 | 26.5 | 73.5 | 8.5 | — | |
| DANNBackbone=ResNet-50, Ten-crop evaluation=false2020.07 | 51.01 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Source OnlyBackbone=ResNet-101, Pre-trained=ImageNet2019.10 | 50.8 | 46.2 | 27.6 | 31.4 | 78.1 | 71.8 | 1.3 | 71.7 | 14.3 | 63.5 | 31 | 93.7 | 3.2 | — | |
| Resnet-50 (Norm-based Baseline)Backbone=ResNet-50, Ten-crop evaluation=false2020.07 | 49.89 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Source modelBackbone=ResNet-101, Source-free=false, Evaluation Setting=G-SFDA2021.08 | 48.1 | 70.6 | 15.6 | 45.6 | 80.9 | 63 | 5.1 | 79.2 | 24.9 | 64 | 39.6 | 84.8 | 6.3 | — | |
| DANBackbone=ResNet-50, Ten-crop evaluation=false2020.07 | 47.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Source OnlyBackbone=ResNeXt2017.11 | 47.4 | 74.3 | 37.6 | 61.8 | 68.2 | 59.5 | 10.7 | 81.4 | 12.8 | 61.6 | 26 | 70 | 5.6 | — | |
| Source model onlyBackbone=ResNet-101, Evaluation Protocol=vanilla closed-set DA, Domain Scenario=Synthesis -> Real2020.02 | 46.6 | 60.9 | 21.6 | 50.9 | 67.6 | 65.8 | 6.3 | 82.2 | 23.2 | 57.3 | 30.6 | 84.6 | 8 | — | |
| Resnet-50 (Source Only)Backbone=ResNet-50, Ten-crop evaluation=false2020.07 | 45.26 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Source onlySource-Free=false, Backbone=ResNet-1012025.05 | 43.8 | 57.2 | 11.1 | 42.4 | 66.9 | 55 | 4.4 | 81.1 | 27.3 | 57.9 | 29.4 | 86.7 | 5.8 | — | |
| ResNet-152 (Source-only)Backbone=ResNet-152, Adaptation Setting=Source-only2017.04 | 40.9 | — | — | — | — | — | — | — | — | — | — | — | — | — |