Verified Robustness on MNIST (test)
77.4Robustness Scorebeta-CROWN
Evaluation results
| Method | Links | ||
|---|---|---|---|
| beta-CROWNModel=MLP 5x200, epsilon=0.0152022.10 | 77.4 | 86 | |
| beta-CROWNModel=MLP 8x200, epsilon=0.0152022.10 | 73.5 | 95 | |
| beta-CROWNModel=ConvSmall, epsilon=0.122022.10 | 72.7 | 7 | |
| beta-CROWNModel=MLP 5x100, epsilon=0.0262022.10 | 69.9 | 102 | |
| PRIMAModel=MLP 5x200, epsilon=0.0152022.10 | 69 | 224 | |
| PRIMAModel=MLP 8x200, epsilon=0.0152022.10 | 62.4 | 395 | |
| beta-CROWNModel=MLP 8x100, epsilon=0.0262022.10 | 62 | 103 | |
| PRIMAModel=ConvSmall, epsilon=0.122022.10 | 59.8 | 42 | |
| ZonoDualModel=ConvSmall, epsilon=0.122022.10 | 52.6 | 38 | |
| PRIMAModel=MLP 5x100, epsilon=0.0262022.10 | 51 | 159 | |
| PRIMAModel=MLP 8x100, epsilon=0.0262022.10 | 42.8 | 301 | |
| ZonoDualModel=MLP 5x200, epsilon=0.0152022.10 | 41.8 | 28 | |
| BDD+Model=MLP 5x200, epsilon=0.0152022.10 | 33.2 | 8 | |
| ZonoDualModel=MLP 8x200, epsilon=0.0152022.10 | 29.7 | 26 | |
| CROWNModel=MLP 5x200, epsilon=0.0152022.10 | 29.2 | 2 | |
| ZonoDualModel=MLP 5x100, epsilon=0.0262022.10 | 28.5 | 24 | |
| BDD+Model=MLP 8x200, epsilon=0.0152022.10 | 27.4 | 17 | |
| CROWNModel=MLP 8x200, epsilon=0.0152022.10 | 25.9 | 6 | |
| ZonoDualModel=MLP 8x100, epsilon=0.0262022.10 | 21.8 | 19 | |
| BDD+Model=MLP 5x100, epsilon=0.0262022.10 | 19.8 | 7 | |
| BDD+Model=MLP 8x100, epsilon=0.0262022.10 | 19.1 | 15 | |
| CROWNModel=MLP 8x100, epsilon=0.0262022.10 | 18.2 | 1 | |
| BDD+Model=ConvSmall, epsilon=0.122022.10 | 16.6 | 6 | |
| CROWNModel=MLP 5x100, epsilon=0.0262022.10 | 16 | 1 | |
| CROWNModel=ConvSmall, epsilon=0.122022.10 | 15.8 | 3 |