Image Classification on CIFAR-10 1.0 (test) (Adversarial Robustness)
86.5Clean AccuracyMART
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| MARTBackbone=WideResNet-34-102023.03 | 86.5 | — | — | 58.5 | 52.6 | 50 | 50.7 | 49.9 | 48 | |
| TRADESBackbone=WideResNet-34-102023.03 | 86.3 | — | — | 57.1 | 52.1 | 50.8 | 50.6 | 50.7 | 49 | |
| ADV + CAFEBackbone=WideResNet-34-102023.03 | 85.7 | — | — | 58.5 | 53.3 | 51.3 | 51.8 | 51.5 | 49.5 | |
| MART + CAFEBackbone=WideResNet-34-102023.03 | 85.7 | — | — | 59.8 | 54.6 | 51.4 | 52.7 | 50.9 | 49.3 | |
| BNBackbone=ResNet-182021.02 | 84.84 | 41.57 | 40.02 | — | — | — | — | — | — | |
| AWP + CAFEBackbone=WideResNet-34-102023.03 | 84.6 | — | — | 60.6 | 56.9 | 52.4 | 55.5 | 52.3 | 51.1 | |
| ADVBackbone=WideResNet-34-102023.03 | 84.3 | — | — | 54.5 | 48.7 | 47.8 | 47 | 47.9 | 45.6 | |
| SaAuxBNBackbone=ResNet-18, Evaluation Branch=adversarial branch2021.02 | 84.08 | 44.93 | 43.14 | — | — | — | — | — | — | |
| HELPBackbone=WideResNet-34-102023.03 | 83.8 | — | — | 58.6 | 54.9 | 51.6 | 53.8 | 51.6 | 50.3 | |
| TRADES + CAFEBackbone=WideResNet-34-102023.03 | 83.7 | — | — | 58.6 | 54.5 | 52 | 53.2 | 52 | 50.1 | |
| AWPBackbone=WideResNet-34-102023.03 | 83.7 | — | — | 58 | 54.7 | 51.3 | 53.7 | 51.2 | 50.1 | |
| MARTBackbone=ResNet-182023.03 | 83.5 | — | — | 56.1 | 50.1 | 47.1 | 48.3 | 47 | 45.5 | |
| AuxBNBackbone=ResNet-18, Evaluation Branch=adversarial branch2021.02 | 83.42 | 43.05 | 41.6 | — | — | — | — | — | — | |
| ModeNormBackbone=ResNet-182021.02 | 83.28 | 43.56 | 41.85 | — | — | — | — | — | — | |
| HELP + CAFEBackbone=WideResNet-34-102023.03 | 83.1 | — | — | 60.5 | 57.1 | 52.7 | 56 | 52.6 | 51.3 | |
| TRADESBackbone=ResNet-182023.03 | 83 | — | — | 55 | 49.8 | 47.5 | 48.3 | 47.3 | 46.1 | |
| ADV + CAFEBackbone=ResNet-182023.03 | 82.6 | — | — | 55.9 | 50.7 | 47.6 | 49 | 47.7 | 46.2 | |
| MART + CAFEBackbone=ResNet-182023.03 | 82.1 | — | — | 57.3 | 51.9 | 48.1 | 50.2 | 48 | 46.2 | |
| ADVBackbone=ResNet-182023.03 | 82 | — | — | 52.1 | 46.5 | 44.8 | 44.8 | 44.8 | 43 | |
| AWP + CAFEBackbone=ResNet-182023.03 | 81.5 | — | — | 57.8 | 54.2 | 49.4 | 52.9 | 49 | 47.8 | |
| AWPBackbone=ResNet-182023.03 | 81.2 | — | — | 55.3 | 51.6 | 48 | 50.5 | 47.8 | 46.9 | |
| TRADES + CAFEBackbone=ResNet-182023.03 | 80.7 | — | — | 56.6 | 51.4 | 48.5 | 50.4 | 48.3 | 46.7 | |
| HELP + CAFEBackbone=ResNet-182023.03 | 80.6 | — | — | 57.8 | 54.5 | 49.4 | 53.1 | 49.5 | 48.5 | |
| HELPBackbone=ResNet-182023.03 | 80.5 | — | — | 55.8 | 52.1 | 48.4 | 51.1 | 48.5 | 47.4 | |
| MARTBackbone=VGG-162023.03 | 79.7 | — | — | 52.4 | 47.2 | 43.4 | 45.5 | 43.8 | 42 | |
| TRADESBackbone=VGG-162023.03 | 79.5 | — | — | 50.4 | 45.7 | 43.2 | 44.4 | 42.9 | 41.8 | |
| ADVBackbone=VGG-162023.03 | 78.5 | — | — | 49.8 | 44.8 | 42.6 | 43.2 | 42.9 | 40.7 | |
| ADV + CAFEBackbone=VGG-162023.03 | 78.4 | — | — | 52.2 | 47.9 | 44.1 | 46.4 | 44.5 | 42.7 | |
| MART + CAFEBackbone=VGG-162023.03 | 78.3 | — | — | 54.2 | 49.7 | 43.9 | 48.1 | 44.5 | 42.7 | |
| AWPBackbone=VGG-162023.03 | 78 | — | — | 51.7 | 48.2 | 43.5 | 47.2 | 43.4 | 42.6 | |
| AWP + CAFEBackbone=VGG-162023.03 | 77.4 | — | — | 54.8 | 51.4 | 44.2 | 50.2 | 44.9 | 43.5 | |
| HELPBackbone=VGG-162023.03 | 77.4 | — | — | 51.8 | 48.3 | 43.9 | 47.3 | 43.9 | 42.9 | |
| TRADES + CAFEBackbone=VGG-162023.03 | 77 | — | — | 51.6 | 47.9 | 44 | 47 | 43.9 | 42.7 | |
| HELP + CAFEBackbone=VGG-162023.03 | 75.6 | — | — | 54.4 | 51.4 | 44.6 | 50.4 | 44.8 | 43.7 |