Adversarial Robustness Evaluation on SVHN (test)
93.37Accuracy (Natural)AT
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ATBackbone=ResNet-18, Sparsity rate=0%, Params=11.2M2025.04 | 93.37 | — | — | — | 58.85 | — | — | 50.14 | 56.27 | 59.8 | 1 | |
| HARPBackbone=VGG-16, Sparsity rate=80%, Params=2.9M2025.04 | 93.22 | — | — | — | 52.96 | — | — | 44.73 | 55.53 | 56.16 | 1.77 | |
| AT_HFBackbone=WideResNet34-102023.12 | 93.16 | 68.21 | 60.46 | 57.92 | 43.41 | 46.79 | 43.7 | 42.88 | — | — | — | |
| EEDBackbone=ResNet-18, Sparsity rate=80%, Params=2.2M2025.04 | 93.15 | — | — | — | 58.37 | — | — | 50.18 | 55.74 | 56.05 | 1.85 | |
| EEDBackbone=VGG-16, Sparsity rate=80%, Params=2.9M2025.04 | 93.14 | — | — | — | 53.12 | — | — | 51.49 | 57.19 | 60.27 | 1.77 | |
| ATBackbone=VGG-16, Sparsity rate=0%, Params=14.7M2025.04 | 93.06 | — | — | — | 55.36 | — | — | 52.28 | 57.64 | 61.49 | 1 | |
| TwinRepBackbone=ResNet-18, Sparsity rate=80%, Params=2.2M2025.04 | 92.96 | — | — | — | 56.26 | — | — | 44.73 | 53.83 | 48.61 | 1.78 | |
| MADBackbone=ResNet-18, Sparsity rate=80%, Params=2.2M2025.04 | 92.84 | — | — | — | 59.8 | — | — | 39.87 | 51.65 | 44.72 | 1.7 | |
| HELP_HFBackbone=WideResNet34-102023.12 | 92.79 | 69.7 | 61.64 | 58.64 | 43.38 | 46.85 | 43.34 | 41.83 | — | — | — | |
| HARPBackbone=ResNet-18, Sparsity rate=80%, Params=2.2M2025.04 | 92.6 | — | — | — | 57.28 | — | — | 45.89 | 54.16 | 51.24 | 1.8 | |
| TwinRepBackbone=VGG-16, Sparsity rate=80%, Params=2.9M2025.04 | 92.6 | — | — | — | 51.24 | — | — | 49.06 | 54.61 | 56.58 | 1.75 | |
| AT_HFBackbone=PreAct ResNet-182023.12 | 92.56 | 67.69 | 59.12 | 57.03 | 42.47 | 45.5 | 41.64 | 40.83 | — | — | — | |
| AT_PGDBackbone=WideResNet34-102023.12 | 92.06 | 64.75 | 55.26 | 53.17 | 36.32 | 38.87 | 36.46 | 35.81 | — | — | — | |
| HELP_HFBackbone=PreAct ResNet-182023.12 | 91.79 | 66.04 | 59.6 | 57.77 | 42.86 | 45.52 | 41.78 | 41.23 | — | — | — | |
| AWP_HFBackbone=PreAct ResNet-182023.12 | 91.69 | 68.63 | 61.68 | 60.89 | 41.58 | 47.82 | 42.04 | 41.24 | — | — | — | |
| AWP_HFBackbone=WideResNet34-102023.12 | 91.56 | 69.58 | 62.85 | 61.52 | 42.72 | 49.36 | 44.22 | 43.03 | — | — | — | |
| HELPBackbone=WideResNet34-102023.12 | 91.34 | 67.65 | 57.32 | 54.93 | 37.26 | 42.15 | 38.71 | 37.89 | — | — | — | |
| TRADES_HFBackbone=PreAct ResNet-182023.12 | 91.31 | 68.74 | 61.13 | 59.72 | 41.37 | 46.94 | 41.05 | 40.56 | — | — | — | |
| HYDRABackbone=ResNet-18, Sparsity rate=80%, Params=2.2M2025.04 | 91.06 | — | — | — | 55.13 | — | — | 47.62 | 52.22 | 46.13 | 1.74 | |
| MART_HFBackbone=WideResNet34-102023.12 | 91.02 | 69.45 | 62.41 | 60.62 | 42.36 | 48.27 | 41.82 | 41.29 | — | — | — | |
| HYDRABackbone=VGG-16, Sparsity rate=80%, Params=2.9M2025.04 | 90.82 | — | — | — | 52.63 | — | — | 46.3 | 53.66 | 53.42 | 1.72 | |
| TRADES_HFBackbone=WideResNet34-102023.12 | 90.73 | 69.3 | 62.23 | 60.33 | 43.65 | 47.34 | 43.35 | 41.18 | — | — | — | |
| MART_HFBackbone=PreAct ResNet-182023.12 | 90.71 | 67.64 | 60.21 | 58.37 | 40.18 | 47.07 | 40.93 | 40.1 | — | — | — | |
| AT_PGDBackbone=PreAct ResNet-182023.12 | 90.46 | 61.62 | 52.79 | 50.19 | 35.03 | 37.64 | 34.6 | 34.1 | — | — | — | |
| HELPBackbone=PreAct ResNet-182023.12 | 90.34 | 62.65 | 56.05 | 53.87 | 36.23 | 40.67 | 34.97 | 34.64 | — | — | — | |
| AWPBackbone=WideResNet34-102023.12 | 90.24 | 65.5 | 60.23 | 58.21 | 37.83 | 43.72 | 39.62 | 38.86 | — | — | — | |
| Flying BirdBackbone=ResNet-18, Sparsity rate=80%, Params=2.2M2025.04 | 90.21 | — | — | — | 57.3 | — | — | 42.01 | 52.06 | 52.23 | 1.76 | |
| Flying BirdBackbone=VGG-16, Sparsity rate=80%, Params=2.9M2025.04 | 90.11 | — | — | — | 52.81 | — | — | 49.18 | 53.29 | 50.78 | 1.73 | |
| MADBackbone=VGG-16, Sparsity rate=80%, Params=2.9M2025.04 | 89.94 | — | — | — | 53.03 | — | — | 40.31 | 49.46 | 47.37 | 1.69 | |
| MARTBackbone=WideResNet34-102023.12 | 89.67 | 66.36 | 58.64 | 57.51 | 36.44 | 43.52 | 37.96 | 37.12 | — | — | — | |
| AWPBackbone=PreAct ResNet-182023.12 | 89.64 | 64.05 | 59.03 | 57.76 | 36.51 | 42.45 | 37.74 | 36.89 | — | — | — | |
| MARTBackbone=PreAct ResNet-182023.12 | 89.13 | 63.19 | 57.46 | 55.4 | 35.84 | 41.67 | 35.62 | 35.15 | — | — | — | |
| TRADESBackbone=WideResNet34-102023.12 | 88.9 | 66.49 | 59.27 | 57.23 | 37.72 | 43.18 | 38.21 | 37.31 | — | — | — | |
| TRADESBackbone=PreAct ResNet-182023.12 | 88.23 | 63.9 | 58.26 | 56.91 | 36.12 | 41.56 | 36.02 | 35.52 | — | — | — | |
| RSTBackbone=ResNet-18, Sparsity rate=80%, Params=2.2M2025.04 | 82.39 | — | — | — | 52.65 | — | — | 36.35 | 46.29 | 39.27 | 1.83 | |
| RSTBackbone=VGG-16, Sparsity rate=80%, Params=2.9M2025.04 | 82.39 | — | — | — | 43.58 | — | — | 45.52 | 41.94 | 38.81 | 1.81 | |
| R-ADMMBackbone=ResNet-18, Sparsity rate=80%, Params=2.2M2025.04 | 74.81 | — | — | — | 52.62 | — | — | 37.4 | 49.73 | 43.4 | 1.63 | |
| R-ADMMBackbone=VGG-16, Sparsity rate=80%, Params=2.9M2025.04 | 65.4 | — | — | — | 48.92 | — | — | 44.64 | 48.39 | 49.85 | 1.66 |