Image Classification on CIFAR-10 Long-Tailed (test) (Adversarial Robustness)
77.27Clean AccuracyAT-BSL-AuA
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| AT-BSL-AuABackbone=WideResNet-34-10, Checkpoint=Last2024.03 | 77.27 | 44.73 | 38.06 | 37.14 | 39.05 | 35.11 | |
| AT-BSL-AuABackbone=WideResNet-34-10, Checkpoint=Best2024.03 | 75.17 | 46.18 | 40.84 | 38.82 | 39.23 | 37.15 | |
| TAETBackbone=ResNet-18, IR=102025.03 | 74.67 | 39.59 | 35.15 | 57.59 | — | 30.57 | |
| AT-BSLBackbone=WideResNet-34-10, Checkpoint=Best2024.03 | 73.19 | 41.84 | 35.6 | 34.86 | 35.99 | 32.8 | |
| REATBackbone=WideResNet-34-10, Checkpoint=Best2024.03 | 73.16 | 41.32 | 35.94 | 35.28 | 35.67 | 33.2 | |
| RoBalBackbone=WideResNet-34-10, Checkpoint=Best2024.03 | 72.82 | 41.34 | 36.42 | 32.48 | 31.95 | 30.49 | |
| AT-BSLBackbone=ResNet-18, IR=102025.03 | 72.74 | 34.13 | 26.86 | 15.67 | — | 25.26 | |
| AT-BSL-RABackbone=ResNet-18, Checkpoint Selection=Last Checkpoint2024.03 | 71.83 | 42.62 | 37.15 | 35.37 | 35.5 | 33.44 | |
| AT-BSL-RABackbone=ResNet-18, Checkpoint Selection=Best Checkpoint2024.03 | 70.86 | 43.06 | 37.94 | 36.24 | 36.04 | 34.24 | |
| RoBalBackbone=WideResNet-34-10, Checkpoint=Last2024.03 | 70.85 | 35.95 | 27.74 | 27.59 | 26.76 | 25.71 | |
| RoBalBackbone=ResNet-18, Checkpoint Selection=Best Checkpoint2024.03 | 70.34 | 40.5 | 35.93 | 31.05 | 31.1 | 29.54 | |
| RoBalBackbone=ResNet-18, Checkpoint Selection=Last Checkpoint2024.03 | 70 | 36.18 | 29 | 27.67 | 26.98 | 25.63 | |
| AT-BSLBackbone=ResNet-18, Checkpoint Selection=Best Checkpoint2024.03 | 68.89 | 40.08 | 35.27 | 33.47 | 33.46 | 31.78 | |
| REATBackbone=WideResNet-34-10, Checkpoint=Last2024.03 | 67.76 | 34.51 | 27.75 | 28.17 | 31.82 | 26.66 | |
| AT-BSLBackbone=ResNet-18, Checkpoint Selection=Last Checkpoint2024.03 | 67.63 | 35.2 | 28.65 | 28.91 | 31.35 | 26.97 | |
| REATBackbone=ResNet-18, Checkpoint Selection=Last Checkpoint2024.03 | 67.58 | 36.99 | 30.93 | 30.83 | 31.62 | 28.61 | |
| REATBackbone=ResNet-18, Checkpoint Selection=Best Checkpoint2024.03 | 67.38 | 40.13 | 35.83 | 33.88 | 33.66 | 32.2 | |
| AT-BSLBackbone=WideResNet-34-10, Checkpoint=Last2024.03 | 65.95 | 33.29 | 27.23 | 27.87 | 31 | 26.45 | |
| GAIRATBackbone=WideResNet-34-10, Checkpoint=Best2024.03 | 59.89 | 33.47 | 30.4 | 26.69 | 26.71 | 25.38 | |
| ATBackbone=WideResNet-34-10, Checkpoint=Best2024.03 | 59.21 | 31.88 | 27.88 | 28.19 | 29.81 | 27.07 | |
| ATBackbone=WideResNet-34-10, Checkpoint=Last2024.03 | 58.25 | 29.77 | 25.29 | 25.71 | 29.83 | 24.94 | |
| LAS-ATBackbone=WideResNet-34-10, Checkpoint=Last2024.03 | 58.19 | 32.98 | 28.89 | 28.75 | 28.58 | 27.9 | |
| LAS-ATBackbone=WideResNet-34-10, Checkpoint=Best2024.03 | 57.52 | 33.66 | 29.86 | 29.6 | 29.44 | 28.84 | |
| GAIRATBackbone=WideResNet-34-10, Checkpoint=Last2024.03 | 56.37 | 29.41 | 27.25 | 23.94 | 23.95 | 23.15 | |
| TRADESBackbone=WideResNet-34-10, Checkpoint=Last2024.03 | 53.85 | 30.44 | 26.23 | 26.57 | 26.77 | 25.59 | |
| LAS-ATBackbone=ResNet-18, Checkpoint Selection=Last Checkpoint2024.03 | 53.5 | 33.14 | 30.09 | 29.13 | 28.84 | 28.3 | |
| ATBackbone=ResNet-18, Checkpoint Selection=Last Checkpoint2024.03 | 52.91 | 29.29 | 25.15 | 25.58 | 27.13 | 24.23 | |
| LAS-ATBackbone=ResNet-18, Checkpoint Selection=Best Checkpoint2024.03 | 52.81 | 33.35 | 30.32 | 29.57 | 29.15 | 28.53 | |
| MARTBackbone=WideResNet-34-10, Checkpoint=Last2024.03 | 52.48 | 33.95 | 31.09 | 29.64 | 29.43 | 28.67 | |
| TRADESBackbone=WideResNet-34-10, Checkpoint=Best2024.03 | 51.28 | 31.58 | 28.7 | 28.45 | 28.36 | 27.72 | |
| AWPBackbone=WideResNet-34-10, Checkpoint=Best2024.03 | 50.91 | 34.28 | 31.85 | 31.23 | 31.01 | 30.06 | |
| GAIRATBackbone=ResNet-18, Checkpoint Selection=Best Checkpoint2024.03 | 50.83 | 30.2 | 27.46 | 21.65 | 21.23 | 20.41 | |
| GAIRATBackbone=ResNet-18, Checkpoint Selection=Last Checkpoint2024.03 | 50.66 | 28.44 | 25.6 | 19.68 | 19.22 | 18.26 | |
| ATBackbone=ResNet-18, Checkpoint Selection=Best Checkpoint2024.03 | 49.35 | 30.09 | 27.3 | 26.93 | 27.08 | 25.76 | |
| AWPBackbone=ResNet-18, Checkpoint Selection=Best Checkpoint2024.03 | 49.29 | 33.78 | 31.2 | 30.53 | 30.36 | 29.53 | |
| MARTBackbone=WideResNet-34-10, Checkpoint=Best2024.03 | 49.13 | 34.33 | 32.32 | 30.73 | 30.13 | 29.6 | |
| MARTBackbone=ResNet-18, Checkpoint Selection=Last Checkpoint2024.03 | 48.8 | 32.6 | 29.78 | 28.45 | 28.12 | 27.3 | |
| AWPBackbone=WideResNet-34-10, Checkpoint=Last2024.03 | 48.65 | 33.21 | 31.07 | 30.33 | 30.14 | 29.4 | |
| MARTBackbone=ResNet-18, Checkpoint Selection=Best Checkpoint2024.03 | 48.61 | 32.75 | 30.29 | 28.82 | 28.46 | 27.73 | |
| AWPBackbone=ResNet-18, Checkpoint Selection=Last Checkpoint2024.03 | 47.75 | 32.77 | 30.83 | 30.01 | 29.68 | 29.12 | |
| TRADESBackbone=ResNet-18, Checkpoint Selection=Last Checkpoint2024.03 | 43.75 | 29.06 | 27.05 | 26.1 | 25.93 | 25.78 | |
| TRADESBackbone=ResNet-18, Checkpoint Selection=Best Checkpoint2024.03 | 43.61 | 29.18 | 27.81 | 26.73 | 26.58 | 26.41 |