Robust Image Classification on CIFAR-10-C common corruptions (test)
89.38Accuracy (Snow)CCAT
Evaluation results
| Method | Links | ||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CCATRejector=Con., Backbone=ResNet-182021.05 | 89.38 | 83.04 | 85.47 | 89.33 | 88.21 | 76.32 | 92.71 | 55.99 | 89.34 | 91.94 | — | — | — | — | — | — | — | — | — | — | |
| CCATRejector=RR, Backbone=ResNet-182021.05 | 89.22 | 85.03 | 86.26 | 89.83 | 88.41 | 77.45 | 92.62 | 58.95 | 89.59 | 92.06 | — | — | — | — | — | — | — | — | — | — | |
| PGD-ATRejector=RR, Backbone=ResNet-182021.05 | 81.89 | 80.87 | 79.42 | 81.9 | 76.95 | 63.49 | 84.02 | 44.03 | 82.18 | 85.12 | — | — | — | — | — | — | — | — | — | — | |
| PGD-ATRejector=EBD, Backbone=ResNet-182021.05 | 81.17 | 78.47 | 77.92 | 80.47 | 79.14 | 61.16 | 83.98 | 42.1 | 80.86 | 83.34 | — | — | — | — | — | — | — | — | — | — | |
| TRADESRejector=RR, Backbone=ResNet-182021.05 | 80.16 | 80.03 | 79.15 | 81 | 74.18 | 63.55 | 82.13 | 45.99 | 80.98 | 84.64 | — | — | — | — | — | — | — | — | — | — | |
| CARLRejector=Margin, Backbone=ResNet-182021.05 | 79.86 | 77.45 | 74.94 | 78 | 74.16 | 56.09 | 81.28 | 40.33 | 78.17 | 82.64 | — | — | — | — | — | — | — | — | — | — | |
| PGD-ATRejector=SNet, Backbone=ResNet-182021.05 | 79.77 | 77.74 | 75.52 | 78.72 | 75.81 | 61.32 | 81.75 | 42.97 | 78.59 | 82.08 | — | — | — | — | — | — | — | — | — | — | |
| TRADESRejector=Con., Backbone=ResNet-182021.05 | 78.75 | 79.89 | 78.48 | 80.92 | 71.61 | 63.53 | 80.97 | 45.22 | 80.53 | 84.5 | — | — | — | — | — | — | — | — | — | — | |
| WinninghandBackbone=WideResNet-28-102024.02 | 74.5 | — | — | — | — | 74.1 | — | — | 76.5 | 12.6 | — | — | — | — | — | — | — | 91.1 | 18.3 | 42.7 | |
| ATRORejector=Margin, Backbone=ResNet-182021.05 | 50.84 | 55.36 | 53.74 | 54.59 | 41.12 | 42.82 | 50.13 | 33.54 | 54.48 | 56.82 | — | — | — | — | — | — | — | — | — | — | |
| l2-ATBackbone=WideResNet-28-102024.02 | 48.7 | — | — | — | — | 67.5 | — | — | 44.1 | 53.2 | — | — | — | — | — | — | — | 77.2 | 26.1 | 47.5 | |
| linf-ATBackbone=WideResNet-28-102024.02 | 44.7 | — | — | — | — | 55.5 | — | — | 53.8 | 56.6 | — | — | — | — | — | — | — | 73.4 | 32.9 | 46.2 | |
| MAXBackbone=WideResNet-28-102024.02 | 42.9 | — | — | — | — | 56.2 | — | — | 49.8 | 57.8 | — | — | — | — | — | — | — | 71 | 35.4 | 49.6 | |
| l1-ATBackbone=WideResNet-28-102024.02 | 41.4 | — | — | — | — | 79 | — | — | 40.5 | 48.9 | — | — | — | — | — | — | — | 78.2 | 22.9 | 46.9 | |
| RAMPBackbone=WideResNet-28-102024.02 | 40.5 | — | — | — | — | 55.5 | — | — | 52.9 | 60.3 | — | — | — | — | — | — | — | 75.5 | 40.2 | 50.9 | |
| E-ATBackbone=WideResNet-28-102024.02 | 35.9 | — | — | — | — | 58.5 | — | — | 50.7 | 55.7 | — | — | — | — | — | — | — | 71.5 | 35.3 | 49.4 | |
| BN testBackbone=ResNet-282026.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 79 | |
| EATABackbone=ResNet-282026.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 80 | |
| Probabilistic OTTA frameworkBackbone=ResNet-282026.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 82 | |
| SourceBackbone=ResNet-282026.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 56 | |
| TENTBackbone=ResNet-282026.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 80 |