Optimal Adversary Problems on MNIST (test)
42.7Average Time (s)2 Partitions
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| 2 PartitionsModel=2 x 50, epsilon_l=5, OBBT=false2021.02 | 42.7 | 100 | — | — | |
| Big-MModel=2 x 50, epsilon_l=5, OBBT=false2021.02 | 57.6 | 100 | — | — | |
| 4 PartitionsModel=2 x 50, epsilon_l=5, OBBT=false2021.02 | 83.9 | 100 | — | — | |
| Partitioned Formulation (N=2)Model=2 x 50, Partitions=22021.02 | 150.9 | — | 6.51 | 93 | |
| Partitioned Formulation (N=4)Model=2 x 50, Partitions=42021.02 | 166.6 | — | 6.51 | 89 | |
| 2 PartitionsModel=2 x 50, epsilon_l=10, OBBT=false2021.02 | 270.4 | 98 | — | — | |
| 2 PartitionsModel=2 x 100, epsilon_l=2.5, OBBT=false2021.02 | 285.1 | 100 | — | — | |
| Partitioned Formulation (N=2)Model=2 x 75, Partitions=22021.02 | 310.5 | — | 4.41 | 37 | |
| 4 PartitionsModel=2 x 50, epsilon_l=10, OBBT=false2021.02 | 398.4 | 98 | — | — | |
| Partitioned Formulation (N=4)Model=2 x 75, Partitions=42021.02 | 424 | — | 4.41 | 31 | |
| Big-MModel=2 x 50, epsilon_l=10, OBBT=false2021.02 | 431.8 | 97 | — | — | |
| Big-MModel=2 x 100, epsilon_l=2.5, OBBT=false2021.02 | 525.2 | 92 | — | — | |
| Big-MModel=2 x 75, Partitions=12021.02 | 547.3 | — | 4.41 | 16 | |
| 4 PartitionsModel=2 x 100, epsilon_l=2.5, OBBT=false2021.02 | 553.9 | 94 | — | — | |
| Partitioned Formulation (N=2)Model=2 x 100, Partitions=22021.02 | 572.9 | — | 2.73 | 13 | |
| 2 PartitionsModel=2 x 100, epsilon_l=5, OBBT=false2021.02 | 587.8 | 59 | — | — | |
| 2 PartitionsModel=CNN1*, epsilon_l=0.25, OBBT=true2021.02 | 618.8 | 86 | — | — | |
| Big-MModel=2 x 50, Partitions=12021.02 | 675 | — | 6.51 | 52 | |
| Big-MModel=2 x 100, Partitions=12021.02 | 710.8 | — | 2.73 | 7 | |
| Partitioned Formulation (N=4)Model=2 x 100, Partitions=42021.02 | 777.9 | — | 2.73 | 10 | |
| 4 PartitionsModel=CNN1*, epsilon_l=0.25, OBBT=true2021.02 | 840 | 87 | — | — | |
| 2 PartitionsModel=CNN1*, epsilon_l=0.5, OBBT=true2021.02 | 1,076 | 16 | — | — | |
| 4 PartitionsModel=2 x 100, epsilon_l=5, OBBT=false2021.02 | 1,084.7 | 48 | — | — | |
| Big-MModel=CNN1*, epsilon_l=0.25, OBBT=true2021.02 | 1,099.7 | 68 | — | — | |
| Big-MModel=2 x 100, epsilon_l=5, OBBT=false2021.02 | 1,587.4 | 38 | — | — | |
| 4 PartitionsModel=CNN1*, epsilon_l=0.5, OBBT=true2021.02 | 2,161.2 | 11 | — | — | |
| Big-MModel=CNN1*, epsilon_l=0.5, OBBT=true2021.02 | 2,293.2 | 2 | — | — |