Robust Verification on MNIST (test)
3.53Average Time (s)B-CROWN
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| B-CROWNModel=CNN-A-Adv, epsilon=0.3, timeout threshold=200s2024.12 | 3.53 | — | 71 | |
| GCP-CROWN (MIP cuts)Model=CNN-A-Adv, epsilon=0.3, timeout threshold=200s2024.12 | 7.34 | — | 70.5 | |
| BICCOSModel=CNN-A-Adv, epsilon=0.3, timeout threshold=200s2024.12 | 13.37 | — | 75.5 | |
| Partition-Based FormulationModel=CNN1, epsilon_infinity=0.050, Number of Partitions=22021.02 | 27.3 | 92 | — | |
| Partition-Based FormulationModel=CNN1, epsilon_infinity=0.050, Number of Partitions=42021.02 | 52.4 | 90 | — | |
| Partition-Based FormulationModel=CNN2, epsilon_infinity=0.100, Number of Partitions=22021.02 | 134.7 | 5 | — | |
| PRIMAModel=CNN-A-Adv, epsilon=0.32024.12 | 135.9 | — | 44.5 | |
| Partition-Based FormulationModel=CNN1, epsilon_infinity=0.075, Number of Partitions=22021.02 | 139.6 | 52 | — | |
| Venus2Model=CNN-A-Adv, epsilon=0.32024.12 | 148.4 | — | 35.5 | |
| Partition-Based FormulationModel=CNN2, epsilon_infinity=0.075, Number of Partitions=22021.02 | 160.7 | 36 | — | |
| Big-MModel=CNN1, epsilon_infinity=0.050, Number of Partitions=12021.02 | 198.5 | 82 | — | |
| Partition-Based FormulationModel=CNN2, epsilon_infinity=0.100, Number of Partitions=42021.02 | 246.3 | 5 | — | |
| Partition-Based FormulationModel=CNN1, epsilon_infinity=0.075, Number of Partitions=42021.02 | 281.6 | 42 | — | |
| Partition-Based FormulationModel=CNN2, epsilon_infinity=0.075, Number of Partitions=42021.02 | 306 | 31 | — | |
| Big-MModel=CNN2, epsilon_infinity=0.100, Number of Partitions=12021.02 | 505.3 | 1 | — | |
| Big-MModel=CNN1, epsilon_infinity=0.075, Number of Partitions=12021.02 | 632.5 | 30 | — | |
| Big-MModel=CNN2, epsilon_infinity=0.075, Number of Partitions=12021.02 | 667.1 | 21 | — |