Image Classification on CIFAR-10 (test) (Standard Accuracy and PGD Robustness)
94.64Accuracyno AT
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| no ATStep=-, Backbone=ResNet182026.01 | 94.64 | 0 | 0 | 0 | 0 | 0.57 | |
| FGSM-CKPTStep=1, Backbone=ResNet182026.01 | 90.02 | 41.19 | 38.81 | 37.42 | 37.22 | 1.05 | |
| FGSM-CKPT + QUB-decreasingStep=1, Backbone=ResNet182026.01 | 88.56 | 43.87 | 41.88 | 40.7 | 39.85 | 1.35 | |
| FGSM-CKPT + QUB-staticStep=1, Backbone=ResNet182026.01 | 87.63 | 45.41 | 43.78 | 42.54 | 41.53 | 1.35 | |
| FGSM-RSStep=1, Backbone=ResNet182026.01 | 84.32 | 47.28 | 45.6 | 44.66 | 43.34 | 0.86 | |
| NuATStep=1, Backbone=ResNet182026.01 | 82.99 | 51.4 | 50.33 | 49.6 | 47.7 | 1.36 | |
| FGSM-GAStep=1, Backbone=ResNet182026.01 | 82.93 | 49.89 | 48.53 | 47.74 | 45.75 | 3.02 | |
| PGD-AT + QUB-decreasingStep=10, Backbone=ResNet182026.01 | 82.78 | 53.33 | 52.31 | 51.58 | 49.02 | 2.64 | |
| ELLE-AStep=1, Backbone=ResNet182026.01 | 82.14 | 47.91 | 46.39 | 45.57 | 43.52 | 0.97 | |
| TRADESStep=10, Backbone=ResNet182026.01 | 82.11 | 54.25 | 53.39 | 52.77 | 50.16 | 3.5 | |
| FGSM-GA + QUB-decreasingStep=1, Backbone=ResNet182026.01 | 81.83 | 50.88 | 49.83 | 49.07 | 46.74 | 3.27 | |
| GATStep=1, Backbone=ResNet182026.01 | 81.64 | 54.78 | 53.87 | 53.3 | 47.96 | 1.45 | |
| FGSM-UAPStep=1, Backbone=ResNet182026.01 | 81.62 | 53.38 | 52.59 | 51.83 | 47.75 | 1.18 | |
| FGSM-PGI(MEP) + QUB-decreasingStep=1, Backbone=ResNet182026.01 | 81.56 | 53.95 | 52.99 | 52.24 | 48.58 | 1.19 | |
| PGD-ATStep=10, Backbone=ResNet182026.01 | 81.53 | 52.99 | 52.3 | 51.82 | 48.33 | 2.34 | |
| FGSM-PGI(MEP)Step=1, Backbone=ResNet182026.01 | 81.48 | 53.43 | 52.47 | 51.75 | 48.41 | 0.89 | |
| N-FGSMStep=1, Backbone=ResNet182026.01 | 81.21 | 49.12 | 48.02 | 47.36 | 45.17 | 0.58 | |
| ELLE-A + QUB-decreasingStep=1, Backbone=ResNet182026.01 | 80.96 | 49.7 | 48.62 | 47.88 | 45.55 | 1.21 | |
| N-FGSM + QUB-decreasingStep=1, Backbone=ResNet182026.01 | 80.77 | 50.3 | 49.35 | 48.7 | 46.6 | 0.7 | |
| N-FGSM + QUB-staticStep=1, Backbone=ResNet182026.01 | 80.76 | 51.19 | 50.24 | 49.6 | 47 | 0.7 | |
| FGSM-UAP + QUB-decreasingStep=1, Backbone=ResNet182026.01 | 80.54 | 54.07 | 53.32 | 52.43 | 47.8 | 1.49 | |
| FGSM-PGI(MEP) + QUB-staticStep=1, Backbone=ResNet182026.01 | 80.45 | 53.99 | 53.16 | 52.43 | 48.35 | 1.19 | |
| PGD-AT + QUB-staticStep=10, Backbone=ResNet182026.01 | 80.24 | 54.58 | 53.87 | 53.39 | 49.91 | 2.64 | |
| FGSM-GA + QUB-staticStep=1, Backbone=ResNet182026.01 | 79.75 | 52.24 | 51.33 | 50.82 | 47.33 | 3.27 | |
| FGSM-UAP + QUB-staticStep=1, Backbone=ResNet182026.01 | 79.7 | 54.25 | 53.51 | 52.77 | 47.76 | 1.49 | |
| ELLE-A + QUB-staticStep=1, Backbone=ResNet182026.01 | 77.6 | 50.2 | 49.44 | 48.86 | 45.51 | 1.21 | |
| Free-AT + QUB-decreasingStep=1, Backbone=ResNet182026.01 | 76.1 | 45.58 | 44.89 | 44.35 | 41.6 | 0.56 | |
| Free-ATStep=1, Backbone=ResNet182026.01 | 75.99 | 45.32 | 44.74 | 44.27 | 41.38 | 0.3 | |
| Free-AT + QUB-staticStep=1, Backbone=ResNet182026.01 | 72.98 | 46.72 | 46.19 | 45.89 | 42.82 | 0.56 | |
| FGSM-RS + QUB-decreasingStep=1, Backbone=ResNet182026.01 | 72.9 | 43.85 | 42.96 | 42.52 | 39.31 | 1.16 | |
| FGSM-RS + QUB-staticStep=1, Backbone=ResNet182026.01 | 71.13 | 42.96 | 42.19 | 41.54 | 38.48 | 1.16 |