Image Classification on MNIST (test) (Adversarial Robustness: FGSM, PGD, CW, APGD Suite)
95.8FGSM AccuracyDVERGE
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| DVERGEepsilon=0.12021.04 | 95.8 | 74.9 | 69.2 | 75.3 | — | — | 65.4 | 63.2 | |
| TRSepsilon=0.12021.04 | 95.6 | 93.3 | 93 | 92.9 | — | — | 92.1 | 91.7 | |
| TRSepsilon=0.22021.04 | 91.7 | — | — | — | — | — | — | — | |
| DVERGEepsilon=0.22021.04 | 91.6 | — | — | — | — | — | — | — | |
| Cos-l2epsilon=0.12021.04 | 91.2 | 76.2 | 73.4 | 74.1 | — | — | 70.6 | 69.8 | |
| GradientBoostepsilon=0.12021.04 | 73.2 | 2.4 | 1.5 | 1.6 | — | — | 0.2 | 0.2 | |
| CKAEepsilon=0.12021.04 | 72.6 | 4.2 | 1.4 | 1.2 | — | — | 0.5 | 0.1 | |
| Cos-l2epsilon=0.22021.04 | 72.5 | — | — | — | — | — | — | — | |
| ADPepsilon=0.12021.04 | 71.7 | 7.7 | 4.5 | 13.8 | — | — | 2.1 | 1.4 | |
| AdaBoostepsilon=0.12021.04 | 70.2 | 2.6 | 1.9 | 1.9 | — | — | 0.5 | 0.2 | |
| Cos-onlyepsilon=0.12021.04 | 66.2 | 0.4 | 0 | 0.4 | — | — | 0 | 0 | |
| CKAEepsilon=0.22021.04 | 42.5 | — | — | — | — | — | — | — | |
| AdaBoostepsilon=0.22021.04 | 39.4 | — | — | — | — | — | — | — | |
| GALepsilon=0.12021.04 | 35.7 | 4.6 | 4.1 | 0.8 | — | — | 1.9 | 1.2 | |
| GradientBoostepsilon=0.22021.04 | 34.2 | — | — | — | — | — | — | — | |
| Cos-onlyepsilon=0.22021.04 | 30.7 | — | — | — | — | — | — | — | |
| ADPepsilon=0.22021.04 | 20 | — | — | — | — | — | — | — | |
| GALepsilon=0.22021.04 | 7.8 | — | — | — | — | — | — | — | |
| AdaBoostepsilon=0.152021.04 | — | 0 | 0 | 0 | — | — | 0 | 0 | |
| AdaBoostc=0.12021.04 | — | — | — | — | 81.2 | — | — | — | |
| AdaBoostc=1.02021.04 | — | — | — | — | 66.3 | — | — | — | |
| AdaBoostc=5.02021.04 | — | — | — | — | — | 0.2 | — | — | |
| AdaBoostc=10.02021.04 | — | — | — | — | — | 0 | — | — | |
| ADPepsilon=0.152021.04 | — | 0.1 | 1 | 1 | — | — | 0.5 | 0.4 | |
| ADPc=0.12021.04 | — | — | — | — | 97.9 | — | — | — | |
| ADPc=1.02021.04 | — | — | — | — | 90.1 | — | — | — | |
| ADPc=5.02021.04 | — | — | — | — | — | 2.2 | — | — | |
| ADPc=10.02021.04 | — | — | — | — | — | 0 | — | — | |
| CKAEepsilon=0.152021.04 | — | 0.4 | 0.5 | 0.3 | — | — | 0.1 | 0.1 | |
| CKAEc=0.12021.04 | — | — | — | — | 83.4 | — | — | — | |
| CKAEc=1.02021.04 | — | — | — | — | 69.5 | — | — | — | |
| CKAEc=5.02021.04 | — | — | — | — | — | 0.1 | — | — | |
| CKAEc=10.02021.04 | — | — | — | — | — | 0 | — | — | |
| Cos-l2epsilon=0.152021.04 | — | 47.9 | 30.2 | 35.5 | — | — | 26.3 | 25.4 | |
| Cos-l2c=0.12021.04 | — | — | — | — | 89.2 | — | — | — | |
| Cos-l2c=1.02021.04 | — | — | — | — | 54.4 | — | — | — | |
| Cos-l2c=5.02021.04 | — | — | — | — | — | 6.9 | — | — | |
| Cos-l2c=10.02021.04 | — | — | — | — | — | 0.8 | — | — | |
| Cos-onlyepsilon=0.152021.04 | — | 0 | 0 | 0 | — | — | 0 | 0 | |
| Cos-onlyc=0.12021.04 | — | — | — | — | 85.6 | — | — | — | |
| Cos-onlyc=1.02021.04 | — | — | — | — | 58.6 | — | — | — | |
| Cos-onlyc=5.02021.04 | — | — | — | — | — | 4.1 | — | — | |
| Cos-onlyc=10.02021.04 | — | — | — | — | — | 0.5 | — | — | |
| DVERGEepsilon=0.152021.04 | — | 47.7 | 28.8 | 44.6 | — | — | 27.4 | 26.1 | |
| DVERGEc=0.12021.04 | — | — | — | — | 97.3 | — | — | — | |
| DVERGEc=1.02021.04 | — | — | — | — | 79.2 | — | — | — | |
| DVERGEc=5.02021.04 | — | — | — | — | — | 0 | — | — | |
| DVERGEc=10.02021.04 | — | — | — | — | — | 0 | — | — | |
| GALepsilon=0.152021.04 | — | 2.5 | 0.6 | 0.2 | — | — | 0.2 | 0.2 | |
| GALc=0.12021.04 | — | — | — | — | 97.4 | — | — | — | |
| GALc=1.02021.04 | — | — | — | — | 68.3 | — | — | — | |
| GALc=5.02021.04 | — | — | — | — | — | 0.2 | — | — | |
| GALc=10.02021.04 | — | — | — | — | — | 0.2 | — | — | |
| GradientBoostepsilon=0.152021.04 | — | 0.2 | 0 | 0.1 | — | — | 0 | 0 | |
| GradientBoostc=0.12021.04 | — | — | — | — | 80.5 | — | — | — | |
| GradientBoostc=1.02021.04 | — | — | — | — | 65.8 | — | — | — | |
| GradientBoostc=5.02021.04 | — | — | — | — | — | 0.1 | — | — | |
| GradientBoostc=10.02021.04 | — | — | — | — | — | 0 | — | — | |
| TRSepsilon=0.152021.04 | — | 85.7 | 85.1 | 85.1 | — | — | 83.4 | 82.8 | |
| TRSc=0.12021.04 | — | — | — | — | 98.1 | — | — | — | |
| TRSc=1.02021.04 | — | — | — | — | 92.6 | — | — | — | |
| TRSc=5.02021.04 | — | — | — | — | — | 23.3 | — | — | |
| TRSc=10.02021.04 | — | — | — | — | — | 1.4 | — | — |