Image Classification on CIFAR-100-C v1 (test)
28.8Error Rate (Average)AENIB
Evaluation results
| Method | Links | |||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AENIBData Augmentation=PixMix+2023.03 | 28.8 | 21.2 | 24.4 | 26 | 27.8 | 31.1 | 34.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ARP-SPBackbone=ResNeXt2021.08 | 31 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DMNBackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | 31.39 | — | — | — | — | — | — | 17.26 | 20.32 | 13.44 | 36.86 | 15.23 | 40.23 | 45.85 | 42.77 | 44 | 39.05 | 51.71 | 27.21 | 27.93 | 19.54 | 29.44 | — | |
| SourceBackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | 31.78 | — | — | — | — | — | — | 16.18 | 17.76 | 17.55 | 39.08 | 17.63 | 38.55 | 43.81 | 42.34 | 43.41 | 39.59 | 50.38 | 29.41 | 28.8 | 22.83 | 29.38 | — | |
| RoTTABackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | 31.86 | — | — | — | — | — | — | 16.57 | 18.3 | 17.73 | 38.58 | 17.67 | 38.58 | 43.71 | 42.44 | 43.38 | 39.25 | 50.72 | 28.96 | 28.83 | 23.43 | 29.79 | — | |
| PixMix+Data Augmentation=PixMix+2023.03 | 32 | 23.2 | 26.7 | 28.7 | 30.8 | 35 | 39 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TPTBackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | 32.21 | — | — | — | — | — | — | 15.99 | 17.58 | 17.44 | 39.17 | 19.57 | 38.9 | 43.89 | 43.56 | 44.49 | 40.03 | 50.92 | 27.73 | 30.95 | 23.33 | 29.61 | — | |
| ZEROBackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | 32.55 | — | — | — | — | — | — | 15.91 | 17.91 | 19.53 | 41.1 | 17.18 | 39.79 | 44.78 | 43.33 | 43.47 | 40.99 | 51.27 | 29.41 | 30.62 | 21.81 | 31.14 | — | |
| ECALPBackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | 32.85 | — | — | — | — | — | — | 18.36 | 19.56 | 17.87 | 38.74 | 17.72 | 39.64 | 44.71 | 43.34 | 45.14 | 40.6 | 52.56 | 31.01 | 30.33 | 23.01 | 30.17 | — | |
| ARP-SPBackbone=WideResNet2021.08 | 32.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MEMOBackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | 32.91 | — | — | — | — | — | — | 16.51 | 18.17 | 18.19 | 41.49 | 17.48 | 40.34 | 45.94 | 44.18 | 43.94 | 40.79 | 52.64 | 29.6 | 30.52 | 22.78 | 31.05 | — | |
| VTEBackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | 33.14 | — | — | — | — | — | — | 16.83 | 18.33 | 19.01 | 39.62 | 22.89 | 39.1 | 43.83 | 44.58 | 44.86 | 39.18 | 49.39 | 28.34 | 34.14 | 26.92 | 30.11 | — | |
| TDABackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | 33.27 | — | — | — | — | — | — | 18.21 | 21.36 | 19.35 | 40.51 | 17.73 | 40.16 | 45.11 | 44.78 | 45.55 | 40.37 | 52.16 | 30.42 | 29.32 | 22.58 | 31.42 | — | |
| APR-SBackbone=ResNeXt2021.08 | 33.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AENIBData Augmentation=AugMix2023.03 | 34 | 21.9 | 26.4 | 29.1 | 32.4 | 37.8 | 44.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AugMixBackbone=ResNeXt2021.08 | 34.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| APR-SBackbone=WideResNet2021.08 | 35.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AENIB2023.03 | 35.8 | 22.6 | 27.6 | 30.5 | 34.1 | 39.8 | 47.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ARP-SPBackbone=DenseNet2021.08 | 35.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ARP-SPBackbone=AllConvNet2021.08 | 35.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AugMixBackbone=WideResNet2021.08 | 35.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MINTBackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | 37.09 | — | — | — | — | — | — | 23.81 | 26.29 | 21.36 | 45.67 | 24 | 42.27 | 49 | 46.2 | 44.95 | 43.11 | 56.2 | 38.88 | 34.05 | 28.08 | 32.47 | — | |
| BATCLIPBackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | 37.68 | — | — | — | — | — | — | 21.45 | 24.54 | 22.85 | 46.17 | 23.2 | 44.86 | 49.82 | 47.01 | 46.62 | 44.98 | 58.58 | 38.72 | 34.69 | 28.45 | 33.23 | — | |
| WATTBackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | 37.85 | — | — | — | — | — | — | 21.4 | 22.34 | 23.29 | 47.58 | 18.63 | 44.03 | 49.82 | 47.62 | 47.86 | 45.32 | 57.62 | 43.61 | 33.05 | 29.71 | 35.81 | — | |
| APR-SBackbone=DenseNet2021.08 | 38.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AugMixData Augmentation=AugMix2023.03 | 39 | 24.9 | 29.9 | 33.3 | 37.1 | 43.6 | 51.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SubTTABackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | 39.38 | — | — | — | — | — | — | 25.58 | 27.39 | 24.28 | 46.73 | 26.62 | 44.17 | 50.04 | 47.87 | 47.9 | 45.58 | 57.72 | 41.09 | 37.02 | 32.97 | 35.75 | — | |
| AugMixBackbone=DenseNet2021.08 | 39.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| APR-SBackbone=AllConvNet2021.08 | 39.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Cross-entropy2023.03 | 41.3 | 25.1 | 31.4 | 35.1 | 39.3 | 46.8 | 54 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| VIB2023.03 | 42.2 | 26 | 31.9 | 35.9 | 40.4 | 47.8 | 55.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AugMixBackbone=AllConvNet2021.08 | 42.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| APR-PBackbone=ResNeXt2021.08 | 44.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| APR-PBackbone=WideResNet2021.08 | 44.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| APR-PBackbone=AllConvNet2021.08 | 47.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AutoAugmentBackbone=WideResNet2021.08 | 49.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| APR-PBackbone=DenseNet2021.08 | 49.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MixupBackbone=WideResNet2021.08 | 50.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AutoAugmentBackbone=ResNeXt2021.08 | 51.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MixupBackbone=ResNeXt2021.08 | 51.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutMixBackbone=WideResNet2021.08 | 52.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| StandardBackbone=WideResNet2021.08 | 53.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MixupBackbone=AllConvNet2021.08 | 53.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| StandardBackbone=ResNeXt2021.08 | 53.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutoutBackbone=WideResNet2021.08 | 53.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AutoAugmentBackbone=DenseNet2021.08 | 53.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutMixBackbone=ResNeXt2021.08 | 54.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Adv TrainingBackbone=ResNeXt2021.08 | 54.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutoutBackbone=ResNeXt2021.08 | 54.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AutoAugmentBackbone=AllConvNet2021.08 | 55.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Adv TrainingBackbone=WideResNet2021.08 | 55.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Adv TrainingBackbone=DenseNet2021.08 | 55.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MixupBackbone=DenseNet2021.08 | 55.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutMixBackbone=AllConvNet2021.08 | 56 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Adv TrainingBackbone=AllConvNet2021.08 | 56 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| StandardBackbone=AllConvNet2021.08 | 56.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutoutBackbone=AllConvNet2021.08 | 56.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutMixBackbone=DenseNet2021.08 | 59.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| StandardBackbone=DenseNet2021.08 | 59.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutoutBackbone=DenseNet2021.08 | 59.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ACLPre-training Dataset (D1)=CIFAR-10, Finetuning Protocol=SLF2023.04 | — | — | 31.39 | — | 27.76 | — | 23.27 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ACLPre-training Dataset (D1)=CIFAR-10, Finetuning Protocol=ALF2023.04 | — | — | 27.8 | — | 25.09 | — | 21.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ACLPre-training Dataset (D1)=CIFAR-10, Finetuning Protocol=AFF2023.04 | — | — | 52.07 | — | 44.22 | — | 36.31 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ACL-AIRPre-training Dataset (D1)=CIFAR-10, Finetuning Protocol=SLF2023.04 | — | — | 37.82 | — | 32.83 | — | 27.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ACL-AIRPre-training Dataset (D1)=CIFAR-10, Finetuning Protocol=ALF2023.04 | — | — | 34.67 | — | 30.09 | — | 25.07 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ACL-AIRPre-training Dataset (D1)=CIFAR-10, Finetuning Protocol=AFF2023.04 | — | — | 52.81 | — | 44.95 | — | 37.01 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Adv TrainingBackbone=AllConvNet2019.12 | — | 56 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Adv TrainingBackbone=DenseNet2019.12 | — | 55.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Adv TrainingBackbone=WideResNet2019.12 | — | 55.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Adv TrainingBackbone=ResNeXt2019.12 | — | 54.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AugMixModel=AllConvNet2025.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 42.749 | |
| AugMixModel=DenseNet2025.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 36.863 | |
| AugMixModel=WideResNet2025.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 35.338 | |
| AUGMIXBackbone=AllConvNet2019.12 | — | 42.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AUGMIXBackbone=DenseNet2019.12 | — | 39.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AUGMIXBackbone=WideResNet2019.12 | — | 35.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AUGMIXBackbone=ResNeXt2019.12 | — | 34.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AutoAugment*Backbone=AllConvNet2019.12 | — | 55.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AutoAugment*Backbone=DenseNet2019.12 | — | 53.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AutoAugment*Backbone=WideResNet2019.12 | — | 49.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AutoAugment*Backbone=ResNeXt2019.12 | — | 51.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutMixBackbone=AllConvNet2019.12 | — | 56 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutMixBackbone=DenseNet2019.12 | — | 59.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutMixBackbone=WideResNet2019.12 | — | 52.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutMixBackbone=ResNeXt2019.12 | — | 54.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutoutBackbone=AllConvNet2019.12 | — | 56.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutoutBackbone=DenseNet2019.12 | — | 59.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutoutBackbone=WideResNet2019.12 | — | 53.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutoutBackbone=ResNeXt2019.12 | — | 54.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DynACLPre-training Dataset (D1)=CIFAR-10, Finetuning Protocol=SLF2023.04 | — | — | 26.74 | — | 23.97 | — | 20.87 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DynACLPre-training Dataset (D1)=CIFAR-10, Finetuning Protocol=ALF2023.04 | — | — | 23.7 | — | 21.43 | — | 18.84 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DynACLPre-training Dataset (D1)=CIFAR-10, Finetuning Protocol=AFF2023.04 | — | — | 52.87 | — | 44.87 | — | 36.76 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DynACL-AIRPre-training Dataset (D1)=CIFAR-10, Finetuning Protocol=SLF2023.04 | — | — | 30.35 | — | 26.53 | — | 22.76 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DynACL-AIRPre-training Dataset (D1)=CIFAR-10, Finetuning Protocol=ALF2023.04 | — | — | 27.67 | — | 24.35 | — | 20.96 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DynACL-AIRPre-training Dataset (D1)=CIFAR-10, Finetuning Protocol=AFF2023.04 | — | — | 54 | — | 46.01 | — | 37.75 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MixupBackbone=AllConvNet2019.12 | — | 53.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MixupBackbone=DenseNet2019.12 | — | 55.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MixupBackbone=WideResNet2019.12 | — | 50.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MixupBackbone=ResNeXt2019.12 | — | 51.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| REVaModel=AllConvNet2025.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 34.834 |