Image Classification on CIFAR-10-C v1 (test)
8.954Classification ErrorREVa
Evaluation results
| Method | Links | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| REVaModel=DenseNet2025.09 | 8.954 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| REVaModel=WideResNet2025.09 | 9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| REVaModel=AllConvNet2025.09 | 10.894 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AUGMIXBackbone=ResNeXt2019.12 | 10.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AUGMIXBackbone=WideResNet2019.12 | 11.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AugMixModel=WideResNet2025.09 | 11.23 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AugMixModel=DenseNet2025.09 | 11.581 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AUGMIXBackbone=DenseNet2019.12 | 12.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AUGMIXBackbone=AllConvNet2019.12 | 15 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AugMixModel=AllConvNet2025.09 | 15.603 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MixupBackbone=WideResNet2019.12 | 22.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MixupBackbone=ResNeXt2019.12 | 22.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AutoAugment*Backbone=WideResNet2019.12 | 23.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AutoAugment*Backbone=ResNeXt2019.12 | 24.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MixupBackbone=AllConvNet2019.12 | 24.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MixupBackbone=DenseNet2019.12 | 24.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Adv TrainingBackbone=WideResNet2019.12 | 26.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AutoAugment*Backbone=DenseNet2019.12 | 26.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutoutBackbone=WideResNet2019.12 | 26.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| StandardBackbone=WideResNet2019.12 | 26.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Adv TrainingBackbone=ResNeXt2019.12 | 27 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutMixBackbone=WideResNet2019.12 | 27.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| StandardModel=WideResNet2025.09 | 27.469 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| StandardBackbone=ResNeXt2019.12 | 27.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Adv TrainingBackbone=DenseNet2019.12 | 27.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Adv TrainingBackbone=AllConvNet2019.12 | 28.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutoutBackbone=ResNeXt2019.12 | 28.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| StandardModel=DenseNet2025.09 | 29.082 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AutoAugment*Backbone=AllConvNet2019.12 | 29.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutMixBackbone=ResNeXt2019.12 | 29.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| StandardBackbone=DenseNet2019.12 | 30.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| StandardBackbone=AllConvNet2019.12 | 30.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutMixBackbone=AllConvNet2019.12 | 31.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| StandardModel=AllConvNet2025.09 | 31.645 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutoutBackbone=DenseNet2019.12 | 32.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutoutBackbone=AllConvNet2019.12 | 32.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CutMixBackbone=DenseNet2019.12 | 33.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AugMax-DuBINModel=ResNet182021.10 | — | 90.36 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AugMax-DuBINModel=WRN40-22021.10 | — | 90.67 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AugMax-DuBINModel=ResNeXt292021.10 | — | 92.11 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AugMixModel=ResNet182021.10 | — | 89.49 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AugMixModel=WRN40-22021.10 | — | 89.01 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AugMixModel=ResNeXt292021.10 | — | 89.08 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BATCLIPBackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | — | — | 52.19 | 55.7 | 53.96 | 76.09 | 55.09 | 74.75 | 75.18 | 77.23 | 78.09 | 74.97 | 86.03 | 77.37 | 67.53 | 58.01 | 61.9 | 68.27 | |
| DMNBackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | — | — | 38.83 | 39.45 | 42.12 | 70.74 | 39.48 | 65.01 | 72.78 | 72.52 | 73.41 | 66.45 | 82.39 | 58.46 | 60.51 | 49.05 | 55.92 | 59.14 | |
| ECALPBackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | — | — | 44.36 | 47.05 | 43.93 | 71.17 | 43.56 | 68.32 | 73.92 | 72.49 | 74.92 | 68.06 | 82.61 | 62.95 | 61.91 | 47.18 | 55.67 | 61.21 | |
| MEMOBackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | — | — | 36.5 | 40.68 | 44.28 | 70.81 | 42.1 | 64.67 | 70.63 | 72.17 | 73.01 | 67.63 | 82.1 | 64.25 | 61.03 | 47.84 | 57.61 | 59.69 | |
| MINTBackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | — | — | 54.18 | 57.78 | 47.3 | 73.49 | 56.01 | 73.71 | 76.39 | 74.94 | 74.46 | 70.16 | 85.66 | 70.6 | 64.66 | 58.85 | 59.53 | 66.51 | |
| NormalModel=ResNet182021.10 | — | 74.75 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NormalModel=WRN40-22021.10 | — | 73.71 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NormalModel=ResNeXt292021.10 | — | 71.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| RoTTABackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | — | — | 36.36 | 41.12 | 43.76 | 69.94 | 42.44 | 64.68 | 70.06 | 71.34 | 72.83 | 67.33 | 81.74 | 65.12 | 60.41 | 49.37 | 57.26 | 59.58 | |
| SourceBackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | — | — | 35.51 | 40.01 | 43.17 | 69.91 | 41.46 | 64.52 | 70.1 | 70.84 | 72.32 | 66.65 | 81.35 | 64.48 | 59.69 | 48.18 | 56.62 | 58.99 | |
| SubTTABackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | — | — | 60.43 | 63.78 | 56.4 | 78.48 | 61.66 | 76.24 | 77.26 | 80.03 | 79.99 | 77.95 | 88.72 | 83.62 | 70.51 | 73.77 | 63.46 | 72.82 | |
| TDABackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | — | — | 41.49 | 43.44 | 41.44 | 71.14 | 44.86 | 66.96 | 72.37 | 72.2 | 74.53 | 68.46 | 83.57 | 65.64 | 62.61 | 51.14 | 55.67 | 61.03 | |
| TPTBackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | — | — | 43.13 | 46.67 | 48.3 | 71.33 | 47.77 | 66.95 | 72.05 | 73.95 | 76.09 | 68.73 | 84.16 | 66.31 | 63.91 | 51.82 | 58.02 | 62.61 | |
| VTEBackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | — | — | 47.55 | 50.18 | 53.11 | 71.35 | 53.87 | 67.89 | 72.95 | 76.37 | 76.24 | 70.76 | 83.33 | 61.05 | 68.99 | 58.57 | 61.07 | 64.89 | |
| WATTBackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | — | — | 43.63 | 48.69 | 49.13 | 72.23 | 46.15 | 66.74 | 71.04 | 73.64 | 74.46 | 71.25 | 83.99 | 73.12 | 61.98 | 59.25 | 62.98 | 63.89 | |
| ZEROBackbone=ViT-B-32, Evaluation Protocol=Test-Time Adaptation2026.01 | — | — | 37.11 | 41.66 | 46.79 | 71.21 | 42.51 | 65.21 | 71.58 | 72.27 | 73.79 | 68.92 | 82.78 | 65.53 | 62.35 | 47.66 | 58.8 | 60.54 |