Image Classification on SVHN 1.0 (test) (Adversarial Robustness)
94.2Natural AccuracyMART
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| MARTBackbone=WideResNet-34-102023.03 | 94.2 | 75 | 58 | 53.1 | 52.8 | 52.8 | 48.9 | |
| AWP + CAFEBackbone=WideResNet-34-102023.03 | 94.2 | 76.9 | 62.7 | 57.5 | 59.2 | 57.1 | 54.6 | |
| ADVBackbone=WideResNet-34-102023.03 | 94 | 71.8 | 56.7 | 53.2 | 51.9 | 52.8 | 49 | |
| HELP + CAFEBackbone=WideResNet-34-102023.03 | 94 | 76.6 | 62.6 | 57.7 | 58.8 | 57.2 | 55 | |
| TRADESBackbone=WideResNet-34-102023.03 | 93.8 | 74 | 58.1 | 53.9 | 53 | 53.4 | 49.9 | |
| MARTBackbone=ResNet-182023.03 | 93.7 | 74.2 | 58.3 | 51.7 | 53.2 | 50.8 | 47.8 | |
| ADV + CAFEBackbone=WideResNet-34-102023.03 | 93.7 | 75.7 | 59.1 | 54.9 | 54 | 54.1 | 50.2 | |
| HELPBackbone=WideResNet-34-102023.03 | 93.5 | 73.4 | 60.8 | 56.5 | 57.6 | 56.1 | 54 | |
| AWP + CAFEBackbone=ResNet-182023.03 | 93.4 | 74 | 60.9 | 55 | 57.8 | 54.8 | 52.7 | |
| TRADESBackbone=ResNet-182023.03 | 93.2 | 72.8 | 57.7 | 52.6 | 53 | 51.5 | 48.9 | |
| AWPBackbone=WideResNet-34-102023.03 | 93.2 | 73.4 | 60.8 | 55.9 | 57.5 | 55.5 | 53.6 | |
| MART + CAFEBackbone=WideResNet-34-102023.03 | 93 | 76.5 | 61.9 | 54.9 | 57.2 | 53.8 | 50.7 | |
| HELP + CAFEBackbone=ResNet-182023.03 | 92.9 | 73.9 | 61.3 | 55.3 | 58.8 | 54.6 | 52.8 | |
| ADVBackbone=ResNet-182023.03 | 92.8 | 70.4 | 55.4 | 51.3 | 50.9 | 51 | 47.5 | |
| MARTBackbone=VGG-162023.03 | 92.6 | 66.6 | 54.2 | 47.9 | 49.6 | 47.1 | 44.4 | |
| HELPBackbone=ResNet-182023.03 | 92.6 | 72 | 59.8 | 54.4 | 56.6 | 53.9 | 52 | |
| ADV + CAFEBackbone=ResNet-182023.03 | 92.5 | 73.6 | 58.9 | 53.8 | 54.9 | 52.6 | 49.8 | |
| TRADES + CAFEBackbone=WideResNet-34-102023.03 | 92.4 | 75.6 | 61 | 55.7 | 58 | 58 | 53 | |
| MART + CAFEBackbone=ResNet-182023.03 | 92.2 | 74.9 | 61 | 53.4 | 57.3 | 51.8 | 49.7 | |
| AWPBackbone=ResNet-182023.03 | 92.2 | 71.1 | 59.8 | 54.3 | 56.8 | 53.6 | 52 | |
| ADVBackbone=VGG-162023.03 | 91.9 | 64.8 | 52.1 | 48.9 | 48 | 48.5 | 45.2 | |
| TRADESBackbone=VGG-162023.03 | 91.9 | 66.4 | 53.6 | 49.1 | 49.1 | 47.7 | 45.2 | |
| AWP + CAFEBackbone=VGG-162023.03 | 91.9 | 67.9 | 58.6 | 51.2 | 55.9 | 51.1 | 49.7 | |
| ADV + CAFEBackbone=VGG-162023.03 | 91.5 | 67 | 55.3 | 50 | 51.3 | 49.6 | 46.1 | |
| HELP + CAFEBackbone=VGG-162023.03 | 91.5 | 67.3 | 58.5 | 51.6 | 56.2 | 51.4 | 50 | |
| MART + CAFEBackbone=VGG-162023.03 | 91.3 | 67.6 | 57.3 | 49.5 | 54.2 | 48.3 | 46.4 | |
| TRADES + CAFEBackbone=ResNet-182023.03 | 91.3 | — | 59.6 | 54.1 | 56.7 | 53.2 | 51.3 | |
| HELPBackbone=VGG-162023.03 | 91.2 | 65.8 | 56.6 | 50.9 | 53.9 | 50.2 | 48.8 | |
| AWPBackbone=VGG-162023.03 | 90.8 | 65.5 | 56.6 | 50.4 | 54 | 49.7 | 48.6 | |
| TRADES + CAFEBackbone=VGG-162023.03 | 90.3 | 67.8 | 56.1 | 50 | 53.6 | 49.1 | 47.5 |