Image Classification on CIFAR-10-C (test)
91.57Accuracy (Clean)DPS
Evaluation results
| Method | Links | ||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DPSModel=ViT-B2025.12 | 91.57 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PS-KDModel=ViT-B2025.12 | 91.38 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TEModel=ViT-B2025.12 | 91.31 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DLBModel=ViT-B2025.12 | 91.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BaselineModel=ViT-B2025.12 | 91.17 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SODA-RCategory=DA, FO Grad.=true, Model Mod.=false2023.10 | 88.39 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MA-SOCategory=MA, FO Grad.=true, Model Mod.=true2023.10 | 86.54 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SODACategory=DA, FO Grad.=false, Model Mod.=false2023.10 | 82.55 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MSLCBackbone=ResNet262023.03 | 81.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TentBackbone=ResNet262023.03 | 80.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SHOT-IMBackbone=ResNet262023.03 | 80.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ETABackbone=ResNet262023.03 | 80.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PLBackbone=ResNet262023.03 | 80.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LAMEBackbone=ResNet262023.03 | 79.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BNBackbone=ResNet262023.03 | 77.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| T3ABackbone=ResNet262023.03 | 77.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BETACategory=Distill., FO Grad.=true, Model Mod.=false2023.10 | 75.71 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DPSModel=ResNet-182025.12 | 74.88 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DPSModel=DenseNet-1212025.12 | 74.85 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DLBModel=DenseNet-1212025.12 | 74.81 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PS-KDModel=DenseNet-1212025.12 | 74.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PS-KDModel=ResNet-182025.12 | 74.28 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DLBModel=ResNet-182025.12 | 73.94 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DINECategory=Distill., FO Grad.=true, Model Mod.=false2023.10 | 73.86 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BaselineModel=DenseNet-1212025.12 | 73.36 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BaselineModel=ResNet-182025.12 | 73.31 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TEModel=ResNet-182025.12 | 73.22 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TEModel=DenseNet-1212025.12 | 73.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DA-PLCategory=DA, FO Grad.=false, Model Mod.=false2023.10 | 72.93 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DeployedFO Grad.=false, Model Mod.=false2023.10 | 72.39 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ERMBackbone=ResNet262023.03 | 70.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DA-DirectCategory=DA, FO Grad.=false, Model Mod.=false2023.10 | 70.48 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DA-ZOO-InputCategory=DA, FO Grad.=false, Model Mod.=false2023.10 | 68.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Generalistcorruptions=without2024.06 | 61.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ContextFlow++Fixed Generalist=true, Context Encoder Type=One-hot binary, Context Encoder Method=variational2024.06 | 57.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ContextFlow++Fixed Generalist=true, Context Encoder Category=One-hot binary, Context Encoder Type=variational2024.06 | 57.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ContextFlow++Fixed Generalist=true, Context Encoder Type=Learned embedding, Context Encoder Method=deterministic2024.06 | 57.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ContextFlow++Fixed Generalist=true, Context Encoder Category=Learned embedding, Context Encoder Type=deterministic2024.06 | 57.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ContextFlow++Fixed Generalist=true, Context Encoder Type=One-hot binary, Context Encoder Method=uniform2024.06 | 57.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ContextFlow++Fixed Generalist=true, Context Encoder Category=One-hot binary, Context Encoder Type=uniform2024.06 | 57.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ContextFlow++Fixed Generalist=true, Context Encoder Type=Integer, Context Encoder Method=arg max2024.06 | 57.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ContextFlow++Fixed Generalist=true, Context Encoder Category=Integer, Context Encoder Type=arg max2024.06 | 57.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ContextFlow++Fixed Generalist=true, Context Encoder Type=Learned embedding, Context Encoder Method=stochastic2024.06 | 56.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ContextFlow++Fixed Generalist=true, Context Encoder Category=Learned embedding, Context Encoder Type=stochastic2024.06 | 56.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ContextFlow++Fixed Generalist=true, Context Encoder Type=Integer, Context Encoder Method=uniform2024.06 | 56.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ContextFlow++Fixed Generalist=true, Context Encoder Category=Integer, Context Encoder Type=uniform2024.06 | 56.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GeneralistConditioning=with corruptions2024.06 | 55.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Generalistcorruptions=with2024.06 | 55.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Lu and Huang [2020]Fixed Generalist=false, Context Encoder Type=Learned embedding, Context Encoder Method=deterministic2024.06 | 52.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Lu and Huang [2020]Fixed Generalist=false, Context Encoder Category=Learned embedding, Context Encoder Type=deterministic2024.06 | 52.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Lu and Huang [2020]Fixed Generalist=false, Context Encoder Type=Integer, Context Encoder Method=arg max2024.06 | 51.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Lu and Huang [2020]Fixed Generalist=false, Context Encoder Category=Integer, Context Encoder Type=arg max2024.06 | 51.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Lu and Huang [2020]Fixed Generalist=false, Context Encoder Type=One-hot binary, Context Encoder Method=variational2024.06 | 50.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Lu and Huang [2020]Fixed Generalist=false, Context Encoder Type=Learned embedding, Context Encoder Method=stochastic2024.06 | 50.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Lu and Huang [2020]Fixed Generalist=false, Context Encoder Category=One-hot binary, Context Encoder Type=variational2024.06 | 50.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Lu and Huang [2020]Fixed Generalist=false, Context Encoder Category=Learned embedding, Context Encoder Type=stochastic2024.06 | 50.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Lu and Huang [2020]Fixed Generalist=false, Context Encoder Type=Integer, Context Encoder Method=uniform2024.06 | 49 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Lu and Huang [2020]Fixed Generalist=false, Context Encoder Category=Integer, Context Encoder Type=uniform2024.06 | 49 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Lu and Huang [2020]Fixed Generalist=false, Context Encoder Type=One-hot binary, Context Encoder Method=uniform2024.06 | 48.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Lu and Huang [2020]Fixed Generalist=false, Context Encoder Category=One-hot binary, Context Encoder Type=uniform2024.06 | 48.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DA-PGDCategory=DA, FO Grad.=false, Model Mod.=false2023.10 | 24.63 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AABackbone=WRN, Source Domain=CIFAR10, Evaluation Protocol=Single Domain Generalization2023.04 | — | 91.42 | 87.88 | 84.1 | 78.46 | 71.13 | — | — | — | — | — | — | — | 82.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ACLPre-training Dataset (D1)=CIFAR-100, Finetuning Protocol=SLF2023.04 | — | 59.65 | — | 55.14 | — | 49.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ACLPre-training Dataset (D1)=CIFAR-100, Finetuning Protocol=ALF2023.04 | — | 56.15 | — | 51.96 | — | 47.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ACLPre-training Dataset (D1)=CIFAR-100, Finetuning Protocol=AFF2023.04 | — | 72.94 | — | 66.05 | — | 59.17 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ACL-AIRPre-training Dataset (D1)=CIFAR-100, Finetuning Protocol=SLF2023.04 | — | 63.34 | — | 58.14 | — | 51.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ACL-AIRPre-training Dataset (D1)=CIFAR-100, Finetuning Protocol=ALF2023.04 | — | 59.14 | — | 54.23 | — | 48.97 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ACL-AIRPre-training Dataset (D1)=CIFAR-100, Finetuning Protocol=AFF2023.04 | — | 73.48 | — | 66.83 | — | 60.21 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ADMAREF=Proposed2023.12 | — | — | — | — | — | — | 12.6 | — | — | — | — | — | — | — | 30.6 | 18.9 | 11.5 | 10.4 | 22.5 | 13.9 | 9.8 | 6.6 | 6.5 | 8.8 | 4 | 8.5 | 12.7 | 9.2 | 14.4 | 15.6 | — | — | — | — | — | — | — | — | |
| ADTE2026.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 89.96 | 85.56 | 88.43 | — | — | 87.65 | — | — | — | — | 91.32 | — | 84.86 | — | — | — | 85.42 | — | — | — | — | — | — | — | |
| AENIB2023.03 | — | — | — | — | — | — | 12.3 | 4.97 | 7.49 | 8.96 | 11 | 14.8 | 19.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AENIBData Augmentation=AugMix2023.03 | — | — | — | — | — | — | 12 | 5.35 | 7.65 | 8.99 | 11 | 14.2 | 18.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AENIBData Augmentation=PixMix+2023.03 | — | — | — | — | — | — | 8.08 | 4.67 | 5.9 | 6.55 | 7.45 | 9.12 | 11.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AENIB2023.03 | — | — | — | — | — | — | — | 12.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AENIBData Augmentation=AugMix2023.03 | — | — | — | — | — | — | — | 12 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AENIBData Augmentation=PixMix2023.03 | — | — | — | — | — | — | — | 8.08 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AugMixBackbone=WRN 40x2, Training Noise Ratio=0%2021.09 | — | — | — | — | — | — | 11.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AugMixData Augmentation=AugMix2023.03 | — | — | — | — | — | — | 15.1 | 6.52 | 8.97 | 10.8 | 13.4 | 18.4 | 23.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AugMix2023.03 | — | — | — | — | — | — | — | 15.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BlurConv1Backbone=ResNet50, Inhibition Mechanism=BlurConv12024.08 | — | — | — | — | — | — | 28.31 | — | — | — | — | — | — | — | 0.85 | 0.86 | 1 | 0.95 | 0.89 | 0.96 | 0.99 | 0.95 | 0.93 | 0.98 | 0.96 | 0.94 | 0.96 | 0.98 | 0.99 | — | — | — | 0.948 | 6.9 | — | — | — | — | |
| BlurConv2Backbone=ResNet50, Inhibition Mechanism=BlurConv22024.08 | — | — | — | — | — | — | 36.48 | — | — | — | — | — | — | — | 1.06 | 1.1 | 1.07 | 1.34 | 1.13 | 1.46 | 1.34 | 1.27 | 1.14 | 1.35 | 1.41 | 1.37 | 1.29 | 1.26 | 1.08 | — | — | — | 1.24 | 9.8 | — | — | — | — | |
| CLIP-ViT/B-162026.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 90.54 | 84.73 | 87.94 | — | — | 87.33 | — | — | — | — | 90.94 | — | 84.33 | — | — | — | 85.01 | — | — | — | — | — | — | — | |
| COTTAREF=CVPR20222023.12 | — | — | — | — | — | — | 24.6 | — | — | — | — | — | — | — | 58.7 | 51.3 | 33 | 20.1 | 34.8 | 20 | 15.2 | 11.1 | 11.3 | 18.5 | 4 | 34.7 | 18.8 | 19 | 17.9 | 3.6 | — | — | — | — | — | — | — | — | |
| Cross-entropy2023.03 | — | — | — | — | — | — | 16 | 6.08 | 8.89 | 11.1 | 14 | 19.7 | 26.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Cross-entropy2023.03 | — | — | — | — | — | — | — | 16 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Deep ensemble2024.07 | — | 88.9 | 83.67 | 77.56 | 70.37 | 58.63 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Deep ensemble+SAM2024.07 | — | 89.44 | 84.24 | 78.16 | 71.04 | 58.77 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DisenIB2023.03 | — | — | — | — | — | — | — | 15.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DynACLPre-training Dataset (D1)=CIFAR-100, Finetuning Protocol=SLF2023.04 | — | 57.14 | — | 52.07 | — | 47.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DynACLPre-training Dataset (D1)=CIFAR-100, Finetuning Protocol=ALF2023.04 | — | 56.31 | — | 52.03 | — | 47.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DynACLPre-training Dataset (D1)=CIFAR-100, Finetuning Protocol=AFF2023.04 | — | 75.89 | — | 69.08 | — | 62.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DynACL-AIRPre-training Dataset (D1)=CIFAR-100, Finetuning Protocol=SLF2023.04 | — | 58.41 | — | 53.09 | — | 47.94 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DynACL-AIRPre-training Dataset (D1)=CIFAR-100, Finetuning Protocol=ALF2023.04 | — | 54.89 | — | 49.84 | — | 45.08 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DynACL-AIRPre-training Dataset (D1)=CIFAR-100, Finetuning Protocol=AFF2023.04 | — | 76.35 | — | 69.49 | — | 62.44 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| EoABackbone=WRN-40-22024.07 | — | — | — | — | — | — | — | — | — | — | — | — | — | 75.57 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ERMBackbone=WRN, Source Domain=CIFAR10, Evaluation Protocol=Single Domain Generalization2023.04 | — | 87.8 | 81.5 | 75.5 | 68.2 | 56.1 | — | — | — | — | — | — | — | 73.82 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FedL2Palpha=1000, local_epochs=152023.10 | — | — | — | — | — | — | — | — | — | — | — | — | — | 59.97 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FedL2Palpha=1.0, local_epochs=152023.10 | — | — | — | — | — | — | — | — | — | — | — | — | — | 68.83 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FedL2Palpha=0.5, local_epochs=152023.10 | — | — | — | — | — | — | — | — | — | — | — | — | — | 76.78 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FedL2Palpha=0.1, local_epochs=152023.10 | — | — | — | — | — | — | — | — | — | — | — | — | — | 89.23 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — |