Robustness Verification on MNIST (test)
0.52Verified Error RateABSCERT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ABSCERTmodel_scale=DM-large, epsilon=0.12023.03 | 0.52 | 77.29 | — | |
| ABSCERTmodel_scale=DM-medium, epsilon=0.12023.03 | 0.69 | 74.16 | — | |
| ABSCERTmodel_scale=DM-small, epsilon=0.12023.03 | 0.89 | 70.53 | — | |
| SECURECROWNModel=3 × [20], Avg. Rob.=0.0304, epsilon=0.015, Result=U (1)2026.07 | 1.08 | — | 100 | |
| SECURECROWNModel=3 × [256], Avg. Rob.=0.0159, epsilon=0.015, Result=U (51)2026.07 | 1.14 | — | 100 | |
| SECURECROWNModel=5 × [256], Avg. Rob.=0.0149, epsilon=0.015, Result=U (50)2026.07 | 1.21 | — | 100 | |
| ABSCERTmodel_scale=DM-small, epsilon=0.42023.03 | 1.22 | 94.05 | — | |
| SECURECROWNModel=7 × [256], Avg. Rob.=0.0132, epsilon=0.015, Result=U (69)2026.07 | 1.32 | — | 100 | |
| SECURECROWNModel=3 × [20], Avg. Rob.=0.0304, epsilon=0.015, Result=R (93)2026.07 | 1.41 | — | 100 | |
| LossLandscapeMattersmodel_scale=DM-large, epsilon=0.12023.03 | 2.29 | — | — | |
| SECURECROWNModel=7 × [256], Avg. Rob.=0.0132, epsilon=0.015, Result=R (30)2026.07 | 2.66 | — | 100 | |
| LossLandscapeMattersmodel_scale=DM-medium, epsilon=0.12023.03 | 2.67 | — | — | |
| LossLandscapeMattersmodel_scale=DM-small, epsilon=0.12023.03 | 3.02 | — | — | |
| SECURECROWNModel=2 × [20], Avg. Rob.=0.0448, epsilon=0.1, Result=All U (99)2026.07 | 3.27 | — | 100 | |
| AdvIBPmodel_scale=DM-small, epsilon=0.12023.03 | 3.34 | — | — | |
| SECURECROWNModel=3 × [20], Avg. Rob.=0.0304, epsilon=0.030, Result=U (50)2026.07 | 3.68 | — | 100 | |
| LBP&Rampmodel_scale=DM-small, epsilon=0.12023.03 | 4.09 | — | — | |
| SECURECROWNModel=2 × [20], Avg. Rob.=0.0448, epsilon=0.015, Result=All R (99)2026.07 | 4.45 | — | 100 | |
| SECURECROWNModel=5 × [256], Avg. Rob.=0.0149, epsilon=0.1, Result=All U (100)2026.07 | 6.16 | — | 100 | |
| SECURECROWNModel=3 × [256], Avg. Rob.=0.0159, epsilon=0.015, Result=R (49)2026.07 | 6.2 | — | 100 | |
| SECURECROWNModel=3 × [20], Avg. Rob.=0.0304, epsilon=0.1, Result=All U (94)2026.07 | 6.85 | — | 100 | |
| SECURECROWNModel=3 × [20], Avg. Rob.=0.0304, epsilon=0.030, Result=R (44)2026.07 | 7.18 | — | 100 | |
| SECURECROWNModel=5 × [256], Avg. Rob.=0.0149, epsilon=0.015, Result=R (50)2026.07 | 7.78 | — | 100 | |
| SECURECROWNModel=2 × [20], Avg. Rob.=0.0448, epsilon=0.045, Result=U (56)2026.07 | 8.7 | — | 100 | |
| SECURECROWNModel=7 × [256], Avg. Rob.=0.0132, epsilon=0.1, Result=All U (99)2026.07 | 9.18 | — | 100 | |
| SECURECROWNModel=3 × [256], Avg. Rob.=0.0159, epsilon=0.1, Result=All U (100)2026.07 | 9.29 | — | 100 | |
| SECURECROWNModel=2 × [20], Avg. Rob.=0.0448, epsilon=0.045, Result=R (43)2026.07 | 9.52 | — | 100 | |
| LossLandscapeMattersmodel_scale=DM-small, epsilon=0.42023.03 | 20.51 | — | — |