List your company
ResearchFormerly WizWand

Robustness Verification on MNIST (test)

0.52Verified Error RateABSCERT
-0.27965.117710.51515.9123Mar 21, 2023Oct 7, 2023Apr 25, 2024Nov 11, 2024May 31, 2025Dec 17, 2025Jul 6, 2026
Updated 4mo ago

Evaluation results

MethodLinks
ABSCERTmodel_scale=DM-large, epsilon=0.12023.030.5277.29—
ABSCERTmodel_scale=DM-medium, epsilon=0.12023.030.6974.16—
ABSCERTmodel_scale=DM-small, epsilon=0.12023.030.8970.53—
SECURECROWNModel=3 × [20], Avg. Rob.=0.0304, epsilon=0.015, Result=U (1)2026.071.08—100
SECURECROWNModel=3 × [256], Avg. Rob.=0.0159, epsilon=0.015, Result=U (51)2026.071.14—100
SECURECROWNModel=5 × [256], Avg. Rob.=0.0149, epsilon=0.015, Result=U (50)2026.071.21—100
ABSCERTmodel_scale=DM-small, epsilon=0.42023.031.2294.05—
SECURECROWNModel=7 × [256], Avg. Rob.=0.0132, epsilon=0.015, Result=U (69)2026.071.32—100
SECURECROWNModel=3 × [20], Avg. Rob.=0.0304, epsilon=0.015, Result=R (93)2026.071.41—100
LossLandscapeMattersmodel_scale=DM-large, epsilon=0.12023.032.29——
SECURECROWNModel=7 × [256], Avg. Rob.=0.0132, epsilon=0.015, Result=R (30)2026.072.66—100
LossLandscapeMattersmodel_scale=DM-medium, epsilon=0.12023.032.67——
LossLandscapeMattersmodel_scale=DM-small, epsilon=0.12023.033.02——
SECURECROWNModel=2 × [20], Avg. Rob.=0.0448, epsilon=0.1, Result=All U (99)2026.073.27—100
AdvIBPmodel_scale=DM-small, epsilon=0.12023.033.34——
SECURECROWNModel=3 × [20], Avg. Rob.=0.0304, epsilon=0.030, Result=U (50)2026.073.68—100
LBP&Rampmodel_scale=DM-small, epsilon=0.12023.034.09——
SECURECROWNModel=2 × [20], Avg. Rob.=0.0448, epsilon=0.015, Result=All R (99)2026.074.45—100
SECURECROWNModel=5 × [256], Avg. Rob.=0.0149, epsilon=0.1, Result=All U (100)2026.076.16—100
SECURECROWNModel=3 × [256], Avg. Rob.=0.0159, epsilon=0.015, Result=R (49)2026.076.2—100
SECURECROWNModel=3 × [20], Avg. Rob.=0.0304, epsilon=0.1, Result=All U (94)2026.076.85—100
SECURECROWNModel=3 × [20], Avg. Rob.=0.0304, epsilon=0.030, Result=R (44)2026.077.18—100
SECURECROWNModel=5 × [256], Avg. Rob.=0.0149, epsilon=0.015, Result=R (50)2026.077.78—100
SECURECROWNModel=2 × [20], Avg. Rob.=0.0448, epsilon=0.045, Result=U (56)2026.078.7—100
SECURECROWNModel=7 × [256], Avg. Rob.=0.0132, epsilon=0.1, Result=All U (99)2026.079.18—100
SECURECROWNModel=3 × [256], Avg. Rob.=0.0159, epsilon=0.1, Result=All U (100)2026.079.29—100
SECURECROWNModel=2 × [20], Avg. Rob.=0.0448, epsilon=0.045, Result=R (43)2026.079.52—100
LossLandscapeMattersmodel_scale=DM-small, epsilon=0.42023.0320.51——