Multi-class Classification on VLCS
99.51Acc (Caltech)WATT-S
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| WATT-SVisual Encoder=ViT-L/142024.06 | 99.51 | 62.76 | 83.02 | 72.21 | 79.38 | — | |
| WATT-SVisual Encoder=ViT-L/142024.06 | 99.51 | 62.76 | 83.02 | 72.21 | 79.38 | — | |
| CLIPVisual Encoder=ViT-L/142024.06 | 99.43 | 69.22 | 83.99 | 68.06 | 80.18 | — | |
| TENTVisual Encoder=ViT-L/142024.06 | 99.43 | 69.07 | 84.08 | 68.23 | 80.2 | — | |
| CLIPARTTVisual Encoder=ViT-L/142024.06 | 99.43 | 69.32 | 83.89 | 67.89 | 80.13 | — | |
| CLIPVisual Encoder=ViT-B/162024.06 | 99.43 | 67.75 | 84.9 | 71.74 | 80.96 | — | |
| TENTVisual Encoder=ViT-B/162024.06 | 99.43 | 67.31 | 85.1 | 71.57 | 80.85 | — | |
| CLIPARTTVisual Encoder=ViT-B/162024.06 | 99.43 | 67.74 | 84.73 | 71.67 | 80.89 | — | |
| CLIPVisual Encoder=ViT-L/142024.06 | 99.43 | 69.22 | 83.99 | 68.06 | 80.18 | — | |
| TENTVisual Encoder=ViT-L/142024.06 | 99.43 | 69.07 | 84.08 | 68.23 | 80.2 | — | |
| CLIPARTTVisual Encoder=ViT-L/142024.06 | 99.43 | 69.32 | 83.89 | 67.89 | 80.13 | — | |
| WATT-PVisual Encoder=ViT-B/162024.06 | 99.36 | 67.55 | 82.53 | 74.75 | 81.05 | — | |
| WATT-SVisual Encoder=ViT-B/162024.06 | 99.36 | 68.59 | 83.24 | 75.16 | 81.59 | — | |
| DomainAdaptorBackbone=ResNet-502025.03 | 98.69 | 69.18 | 76.01 | 73.66 | 79.39 | — | |
| IRM2021.02 | 98.6 | 66 | 71.5 | 69.3 | 76.3 | — | |
| MLDG2021.02 | 98.5 | 61.7 | 75 | 73.6 | 77.2 | — | |
| DADGNetwork Architecture=ResNet-182020.11 | 98.5 | 67.22 | 76.17 | 70.95 | 78.21 | — | |
| TTDG-MGMBackbone=ResNet-502025.03 | 98.49 | 68.72 | 75.3 | 74.12 | 79.15 | — | |
| Mixup2021.02 | 98.4 | 63.4 | 76.1 | 72.9 | 77.7 | — | |
| JiGenNetwork Architecture=ResNet-18, Implementation=Authors' own implementation2020.11 | 98.39 | 63 | 74.91 | 69.37 | 76.42 | — | |
| MMD2021.02 | 98.3 | 65.6 | 75.7 | 69.7 | 77.3 | — | |
| MBDG2021.02 | 98.3 | 68.1 | 76.3 | 68.8 | 77.9 | — | |
| Inference-time Label-Preserving Target ProjectionsBackbone=AlexNet2021.03 | 98.12 | 66.8 | 74.77 | 70.43 | 77.53 | — | |
| GroupDRO2021.02 | 98.1 | 66.4 | 76.1 | 71 | 77.9 | — | |
| ERM2021.02 | 98 | 62.6 | 77.5 | 70.8 | 77.2 | — | |
| TPTVisual Encoder=ViT-L/142024.06 | 97.86 | 52.54 | 76.16 | 69.49 | 74.01 | — | |
| TPTVisual Encoder=ViT-L/142024.06 | 97.86 | 52.54 | 76.16 | 69.49 | 74.01 | — | |
| ERMBackbone=ResNet-502025.03 | 97.63 | 64.2 | 74.41 | 70.39 | 76.66 | — | |
| TPTVisual Encoder=ViT-B/162024.06 | 97.62 | 49.77 | 71.17 | 71.56 | 72.53 | — | |
| RSCBackbone=AlexNet2021.03 | 97.61 | 61.86 | 73.93 | 68.32 | 75.43 | — | |
| CDANN2021.02 | 97.6 | 63.4 | 78.6 | 70.5 | 77.5 | — | |
| MTL2021.02 | 97.6 | 60.6 | 77.2 | 71 | 76.6 | — | |
| RSC2021.02 | 97.5 | 63.1 | 76.2 | 73 | 77.5 | — | |
| DG-MMLDBackbone=AlexNet, Augmentation=Stylized (AdaIN), AdaIN alpha (α)=1, AdaIN p=0.752021.01 | 97.49 | 61.02 | 64.23 | 62.37 | 71.28 | — | |
| DDAIGBackbone=AlexNet, Augmentation=Stylized (AdaIN), AdaIN alpha (α)=1, AdaIN p=0.752021.01 | 97.48 | 60.48 | 65.19 | 62.57 | 71.43 | — | |
| EISNetBackbone=AlexNet2021.03 | 97.33 | 63.49 | 69.83 | 68.02 | 74.67 | — | |
| DANN2021.02 | 97.3 | 63.7 | 74.2 | 72.6 | 76.9 | — | |
| SagNet2021.02 | 97.3 | 61.6 | 77.6 | 73.4 | 77.5 | — | |
| ITTABackbone=ResNet-502025.03 | 97.3 | 66.09 | 75.1 | 72.31 | 77.7 | — | |
| VPTTABackbone=ResNet-502025.03 | 97.25 | 67.69 | 75.22 | 71.78 | 77.98 | — | |
| ARM2021.02 | 97.2 | 62.7 | 75.8 | 70.6 | 76.6 | — | |
| DeepAllNetwork Architecture=ResNet-182020.11 | 97.1 | 62.17 | 73.84 | 67.28 | 75.1 | — | |
| OursBackbone=AlexNet, Domain labels=No, K=32019.11 | 97.02 | 58.37 | 71.4 | 67.89 | 73.67 | — | |
| DG-MMLDBackbone=AlexNet, Augmentation=Original2021.01 | 96.94 | 59.1 | 68.48 | 62.06 | 71.64 | — | |
| Deep AllBackbone=Alexnet2019.03 | 96.93 | 59.18 | 71.96 | 62.57 | 72.66 | — | |
| JiGenBackbone=Alexnet2019.03 | 96.93 | 60.9 | 70.62 | 64.3 | 73.19 | — | |
| JiGenBackbone=AlexNet, Domain labels=No2019.11 | 96.93 | 60.9 | 70.62 | 64.3 | 73.19 | — | |
| JigenBackbone=AlexNet2021.03 | 96.93 | 60.9 | 70.62 | 64.3 | 73.19 | — | |
| JiGenNetwork Architecture=AlexNet2020.11 | 96.93 | 60.9 | 70.62 | 64.3 | 73.19 | — | |
| CORAL2021.02 | 96.9 | 65.7 | 78.7 | 73.3 | 78.7 | — | |
| VREx2021.02 | 96.9 | 64.8 | 75.5 | 69.7 | 76.7 | — | |
| TENTBackbone=ResNet-502025.03 | 96.88 | 64.46 | 73.52 | 71.07 | 76.48 | — | |
| BaselineBackbone=AlexNet, Augmentation=Stylized (AdaIN), AdaIN alpha (α)=1, AdaIN p=0.752021.01 | 96.86 | 60.77 | 68.18 | 63.42 | 72.31 | — | |
| RotationBackbone=AlexNet, Augmentation=Stylized (AdaIN), AdaIN alpha (α)=1, AdaIN p=0.752021.01 | 96.86 | 60.77 | 68.18 | 63.42 | 72.31 | — | |
| DADGNetwork Architecture=AlexNet2020.11 | 96.8 | 63.44 | 70.77 | 66.81 | 74.46 | — | |
| MLDGNetwork Architecture=ResNet-18, Implementation=Authors' own implementation2020.11 | 96.75 | 63.45 | 74.41 | 69.35 | 75.99 | — | |
| NC-TTTBackbone=ResNet-502025.03 | 96.72 | 65.58 | 76.83 | 73.04 | 78.04 | — | |
| OursBackbone=AlexNet, Domain labels=No, K=22019.11 | 96.66 | 58.77 | 71.96 | 68.13 | 73.88 | — | |
| MMLDBackbone=AlexNet2021.03 | 96.66 | 58.77 | 71.96 | 68.13 | 73.88 | — | |
| Deep AllBackbone=AlexNet, Domain labels=No2019.11 | 96.63 | 59.18 | 71.96 | 62.57 | 72.66 | — | |
| OursBackbone=AlexNet, Domain labels=No, K=42019.11 | 96.57 | 58.66 | 72.09 | 66.79 | 73.53 | — | |
| Deep AllBackbone=AlexNet2021.03 | 96.45 | 60.03 | 70.41 | 62.63 | 72.38 | — | |
| Deep AllBackbone=AlexNet, Domain labels=No2019.11 | 95.89 | 57.88 | 72.01 | 67.76 | 73.39 | — | |
| DDAIGBackbone=AlexNet, Augmentation=Original2021.01 | 95.75 | 60.18 | 65.48 | 60.78 | 70.55 | — | |
| FCNetwork Architecture=AlexNet, Implementation=Authors' own implementation2020.11 | 95.68 | 61.48 | 66.79 | 63.13 | 71.77 | — | |
| MLDGNetwork Architecture=AlexNet, Implementation=Authors' own implementation2020.11 | 95.68 | 61.06 | 70.01 | 65.08 | 72.96 | — | |
| D-SAMNetwork Architecture=AlexNet2020.11 | 94.96 | 54.81 | 63.75 | 64.56 | 69.52 | — | |
| Deep AllBackbone=Alexnet2019.03 | 94.95 | 57.45 | 66.06 | 65.87 | 71.08 | — | |
| BaselineBackbone=AlexNet, Augmentation=Original2021.01 | 94.89 | 59.14 | 71.31 | 64.64 | 72.49 | — | |
| MASFBackbone=AlexNet2021.03 | 94.78 | 64.9 | 69.14 | 67.64 | 74.11 | — | |
| MixupBackbone=AlexNet, Variant=feature-level2021.01 | 94.73 | 62.15 | 69.82 | 62.98 | 72.42 | — | |
| RotationBackbone=AlexNet, Augmentation=Original2021.01 | 94.5 | 61.27 | 68.94 | 63.28 | 72 | — | |
| Deep AllBackbone=AlexNet, Domain labels=No2019.11 | 94.45 | 57.45 | 66.06 | 65.87 | 71.08 | — | |
| DeepAllNetwork Architecture=AlexNet2020.11 | 94.44 | 61.3 | 68.11 | 63.58 | 71.86 | — | |
| MMD-AAEBackbone=Alexnet2019.03 | 94.4 | 62.6 | 67.7 | 64.4 | 72.28 | — | |
| MMD-AAEBackbone=AlexNet, Domain labels=Yes2019.11 | 94.4 | 62.6 | 67.7 | 64.4 | 72.28 | — | |
| MMD-AAENetwork Architecture=AlexNet2020.11 | 94.4 | 62.6 | 67.7 | 64.4 | 72.28 | — | |
| Ours-FullPipeline=Image -> E2E2017.10 | 93.63 | 63.49 | 69.99 | 61.32 | 72.11 | — | |
| TFBackbone=Alexnet2019.03 | 93.63 | 63.49 | 69.99 | 61.32 | 72.11 | — | |
| TFBackbone=AlexNet, Domain labels=Yes2019.11 | 93.63 | 63.49 | 69.99 | 61.32 | 72.11 | — | |
| TFNetwork Architecture=AlexNet2020.11 | 93.63 | 63.49 | 69.99 | 61.32 | 72.11 | — | |
| Deep-AllPipeline=Image -> E2E2017.10 | 93.4 | 62.11 | 68.41 | 64.16 | 72.02 | — | |
| Deep AllBackbone=Alexnet2019.03 | 93.4 | 62.11 | 68.41 | 64.16 | 72.02 | — | |
| Deep AllBackbone=AlexNet, Domain labels=No2019.11 | 93.4 | 62.11 | 68.41 | 64.16 | 72.02 | — | |
| SLRCBackbone=Alexnet2019.03 | 92.76 | 62.34 | 65.25 | 63.54 | 70.97 | — | |
| SLRCBackbone=AlexNet, Domain labels=Yes2019.11 | 92.76 | 62.34 | 65.25 | 63.54 | 70.97 | — | |
| Epi-FCRBackbone=AlexNet, Augmentation=Stylized (AdaIN), AdaIN alpha (α)=1, AdaIN p=0.752021.01 | 92.69 | 58.18 | 62.59 | 57.87 | 67.83 | — | |
| Ours-MLPPipeline=Image -> Deep Feature -> Classifier2017.10 | 92.43 | 58.74 | 65.58 | 61.85 | 69.65 | — | |
| CCSABackbone=Alexnet2019.03 | 92.3 | 62.1 | 67.1 | 59.1 | 70.15 | — | |
| CCSABackbone=AlexNet, Domain labels=Yes2019.11 | 92.3 | 62.1 | 67.1 | 59.1 | 70.15 | — | |
| D-SAMBackbone=Alexnet2019.03 | 91.75 | 56.95 | 58.59 | 60.84 | 67.03 | — | |
| D-SAMBackbone=AlexNet, Domain labels=Yes2019.11 | 91.75 | 56.95 | 58.59 | 60.84 | 67.03 | — | |
| Epi-FCRBackbone=AlexNet, Augmentation=Original2021.01 | 91.43 | 61.36 | 63.44 | 60.07 | 69.07 | — | |
| UMLPipeline=Image -> Deep Feature -> Classifier2017.10 | 91.13 | 58.5 | 56.26 | 58.49 | 65.85 | — | |
| MTAE+1HNNPipeline=Image -> Deep Feature -> Classifier2017.10 | 90.71 | 59.24 | 61.09 | 60.2 | 67.81 | — | |
| HEXNetwork Architecture=AlexNet, Implementation=Authors' own implementation2020.11 | 89.63 | 63.67 | 68.51 | 62.12 | 70.98 | — | |
| D-MTAE+1HNNPipeline=Image -> Deep Feature -> Classifier2017.10 | 89.05 | 60.13 | 63.9 | 61.33 | 68.6 | — | |
| D-SAMNetwork Architecture=ResNet-18, Implementation=Authors' own implementation2020.11 | 88.9 | 58.7 | 70.42 | 71.36 | 72.35 | — | |
| CIDDGBackbone=Alexnet2019.03 | 88.83 | 63.06 | 64.38 | 62.1 | 69.59 | — | |
| CIDDGBackbone=AlexNet, Domain labels=Yes2019.11 | 88.83 | 63.06 | 64.38 | 62.1 | 69.59 | — |