Image Classification on ImageNet (Robustness & Calibration Evaluation)
4.3ECEAAA-linear
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AAA-linearBackbone=Wide-ResNet-50, Perturbation Budget (l_inf)=4/2552022.05 | 4.3 | 77.17 | 63.13 | 62.51 | 62.35 | 56.8 | 74.16 | 67.14 | 77.12 | 67.06 | 72.15 | 70.53 | |
| ATBackbone=Wide-ResNet-50, Perturbation Budget (l_inf)=4/2552022.05 | 5.03 | 66.3 | 59.2 | 51.11 | 59.47 | 56.22 | 65.64 | 47.6 | 66.3 | 64.38 | 65.3 | 63.98 | |
| NoneBackbone=Wide-ResNet-50, Perturbation Budget (l_inf)=4/2552022.05 | 5.42 | 77.11 | 52.27 | 9.25 | 53.05 | 13.88 | 71.79 | 20.9 | 77.11 | 64.93 | 71.33 | 65.77 | |
| ATBackbone=ResNeXt-101, Perturbation Budget (l_inf)=4/2552022.05 | 5.74 | 63.94 | 57.99 | 51.47 | 59.14 | 56.49 | 59.4 | 57.53 | 63.94 | 62.51 | 63.18 | 62.26 | |
| RNDBackbone=Wide-ResNet-50, Perturbation Budget (l_inf)=4/2552022.05 | 5.79 | 75.32 | 58.67 | 50.54 | 59.36 | 52.98 | 66.36 | 63.27 | 71.33 | 66.05 | 65.15 | 61.38 | |
| AAA-linearBackbone=ResNeXt-101, Perturbation Budget (l_inf)=4/2552022.05 | 7.38 | 78.21 | 66.32 | 65.77 | 62.72 | 59.6 | 74.06 | 67.26 | 78.21 | 68.51 | 72.91 | 71.48 | |
| NoneBackbone=ResNeXt-101, Perturbation Budget (l_inf)=4/2552022.05 | 8.37 | 78.21 | 54.51 | 11.73 | 54.12 | 13.3 | 70.86 | 24.64 | 78.21 | 66.24 | 72.19 | 67.73 | |
| RNDBackbone=ResNeXt-101, Perturbation Budget (l_inf)=4/2552022.05 | 8.93 | 76.75 | 58.56 | 48.2 | 58.02 | 52.5 | 68.31 | 66.16 | 73.37 | 69.3 | 67.69 | 64.62 |