Robustness Verification on Iris dataset (test)
0Vulnerable SamplesAI2
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| AI2Perturbation Budget epsilon=0.12026.02 | 0 | — | — | — | — | |
| AI2Perturbation Budget epsilon=0.22026.02 | 0 | — | — | — | — | |
| AI2Perturbation Budget epsilon=0.32026.02 | 0 | — | — | — | — | |
| DLVPerturbation Budget epsilon=0.12026.02 | 0 | — | — | — | — | |
| DLVPerturbation Budget epsilon=0.22026.02 | 0 | — | — | — | — | |
| DLVPerturbation Budget epsilon=0.32026.02 | 0 | — | — | — | — | |
| ExactReachPerturbation Budget epsilon=0.12026.02 | 0 | — | — | — | — | |
| ExactReachPerturbation Budget epsilon=0.22026.02 | 0 | — | — | — | — | |
| ExactReachPerturbation Budget epsilon=0.32026.02 | 0 | — | — | — | — | |
| MaxSensPerturbation Budget epsilon=0.12026.02 | 0 | — | — | — | — | |
| MaxSensPerturbation Budget epsilon=0.22026.02 | 0 | — | — | — | — | |
| MaxSensPerturbation Budget epsilon=0.32026.02 | 0 | — | — | — | — | |
| NeurifyPerturbation Budget epsilon=0.12026.02 | 0 | — | — | — | — | |
| NeurifyPerturbation Budget epsilon=0.22026.02 | 0 | — | — | — | — | |
| NeurifyPerturbation Budget epsilon=0.32026.02 | 0 | — | — | — | — | |
| BaBPerturbation Budget epsilon=0.12026.02 | 0 | — | — | — | — | |
| BaBPerturbation Budget epsilon=0.22026.02 | 0 | — | — | — | — | |
| BaBPerturbation Budget epsilon=0.32026.02 | 0 | — | — | — | — | |
| ConvDualPerturbation Budget epsilon=0.12026.02 | 0 | — | — | — | — | |
| ConvDualPerturbation Budget epsilon=0.22026.02 | 0 | — | — | — | — | |
| ConvDualPerturbation Budget epsilon=0.32026.02 | 0 | — | — | — | — | |
| DualityPerturbation Budget epsilon=0.12026.02 | 0 | — | — | — | — | |
| DualityPerturbation Budget epsilon=0.22026.02 | 0 | — | — | — | — | |
| DualityPerturbation Budget epsilon=0.32026.02 | 0 | — | — | — | — | |
| ILPPerturbation Budget epsilon=0.12026.02 | 0 | — | — | — | — | |
| ILPPerturbation Budget epsilon=0.22026.02 | 0 | — | — | — | — | |
| ILPPerturbation Budget epsilon=0.32026.02 | 0 | — | — | — | — | |
| NSVerifyPerturbation Budget epsilon=0.12026.02 | 0 | — | — | — | — | |
| NSVerifyPerturbation Budget epsilon=0.22026.02 | 0 | — | — | — | — | |
| NSVerifyPerturbation Budget epsilon=0.32026.02 | 0 | — | — | — | — | |
| ReluplexPerturbation Budget epsilon=0.12026.02 | 0 | — | — | — | — | |
| ReluplexPerturbation Budget epsilon=0.22026.02 | 0 | — | — | — | — | |
| ReluplexPerturbation Budget epsilon=0.32026.02 | 0 | — | — | — | — | |
| SherlockPerturbation Budget epsilon=0.12026.02 | 0 | — | — | — | — | |
| SherlockPerturbation Budget epsilon=0.22026.02 | 0 | — | — | — | — | |
| SherlockPerturbation Budget epsilon=0.32026.02 | 0 | — | — | — | — | |
| MIP-GurobiPerturbation Budget epsilon=0.12026.02 | 0 | 0.526 | — | — | — | |
| MIP-GurobiPerturbation Budget epsilon=0.22026.02 | 0 | 0.305 | — | — | — | |
| MIP-GurobiPerturbation Budget epsilon=0.32026.02 | 0 | 0.33 | — | — | — | |
| QUBO-GurobiPerturbation Budget epsilon=0.12026.02 | 0 | 1,137 | 198.03 | 304 | 102 | |
| QUBO-GurobiPerturbation Budget epsilon=0.22026.02 | 0 | 5,000 | 240.89 | 379 | 116 | |
| QUBO-GurobiPerturbation Budget epsilon=0.32026.02 | 0 | 5,000 | 255.72 | 384 | 120 | |
| QUBO-CIMPerturbation Budget epsilon=0.12026.02 | 0 | 2.496 | 198.03 | 304 | 102 | |
| QUBO-CIMPerturbation Budget epsilon=0.22026.02 | 0 | 2.602 | 240.89 | 379 | 116 | |
| QUBO-CIMPerturbation Budget epsilon=0.32026.02 | 0 | 2.755 | 255.72 | 384 | 120 | |
| DLVPerturbation Budget epsilon=0.42026.02 | 2 | — | — | — | — | |
| ExactReachPerturbation Budget epsilon=0.42026.02 | 2 | — | — | — | — | |
| NeurifyPerturbation Budget epsilon=0.42026.02 | 2 | — | — | — | — | |
| BaBPerturbation Budget epsilon=0.42026.02 | 2 | — | — | — | — | |
| ConvDualPerturbation Budget epsilon=0.42026.02 | 2 | — | — | — | — | |
| DualityPerturbation Budget epsilon=0.42026.02 | 2 | — | — | — | — | |
| ILPPerturbation Budget epsilon=0.42026.02 | 2 | — | — | — | — | |
| NSVerifyPerturbation Budget epsilon=0.42026.02 | 2 | — | — | — | — | |
| ReluplexPerturbation Budget epsilon=0.42026.02 | 2 | — | — | — | — | |
| SherlockPerturbation Budget epsilon=0.42026.02 | 2 | — | — | — | — | |
| MIP-GurobiPerturbation Budget epsilon=0.42026.02 | 2 | 0.361 | — | — | — | |
| QUBO-GurobiPerturbation Budget epsilon=0.42026.02 | 2 | 5,000 | 300.25 | 494 | 139 | |
| QUBO-CIMPerturbation Budget epsilon=0.42026.02 | 2 | 11.966 | 300.25 | 494 | 139 | |
| AI2Perturbation Budget epsilon=0.42026.02 | 3 | — | — | — | — | |
| MaxSensPerturbation Budget epsilon=0.42026.02 | 3 | — | — | — | — | |
| AI2Perturbation Budget epsilon=0.52026.02 | 6 | — | — | — | — | |
| DLVPerturbation Budget epsilon=0.52026.02 | 6 | — | — | — | — | |
| ExactReachPerturbation Budget epsilon=0.52026.02 | 6 | — | — | — | — | |
| MaxSensPerturbation Budget epsilon=0.52026.02 | 6 | — | — | — | — | |
| NeurifyPerturbation Budget epsilon=0.52026.02 | 6 | — | — | — | — | |
| BaBPerturbation Budget epsilon=0.52026.02 | 6 | — | — | — | — | |
| ConvDualPerturbation Budget epsilon=0.52026.02 | 6 | — | — | — | — | |
| DualityPerturbation Budget epsilon=0.52026.02 | 6 | — | — | — | — | |
| ILPPerturbation Budget epsilon=0.52026.02 | 6 | — | — | — | — | |
| NSVerifyPerturbation Budget epsilon=0.52026.02 | 6 | — | — | — | — | |
| ReluplexPerturbation Budget epsilon=0.52026.02 | 6 | — | — | — | — | |
| SherlockPerturbation Budget epsilon=0.52026.02 | 6 | — | — | — | — | |
| MIP-GurobiPerturbation Budget epsilon=0.52026.02 | 6 | 0.369 | — | — | — | |
| QUBO-GurobiPerturbation Budget epsilon=0.52026.02 | 6 | 5,000 | 320.63 | 497 | 143 | |
| QUBO-CIMPerturbation Budget epsilon=0.52026.02 | 6 | 2.799 | 320.63 | 497 | 143 | |
| ILPPerturbation Budget epsilon=0.62026.02 | 11 | — | — | — | — | |
| AI2Perturbation Budget epsilon=0.62026.02 | 12 | — | — | — | — | |
| DLVPerturbation Budget epsilon=0.62026.02 | 12 | — | — | — | — | |
| ExactReachPerturbation Budget epsilon=0.62026.02 | 12 | — | — | — | — | |
| MaxSensPerturbation Budget epsilon=0.62026.02 | 12 | — | — | — | — | |
| NeurifyPerturbation Budget epsilon=0.62026.02 | 12 | — | — | — | — | |
| BaBPerturbation Budget epsilon=0.62026.02 | 12 | — | — | — | — | |
| ConvDualPerturbation Budget epsilon=0.62026.02 | 12 | — | — | — | — | |
| DualityPerturbation Budget epsilon=0.62026.02 | 12 | — | — | — | — | |
| NSVerifyPerturbation Budget epsilon=0.62026.02 | 12 | — | — | — | — | |
| ReluplexPerturbation Budget epsilon=0.62026.02 | 12 | — | — | — | — | |
| SherlockPerturbation Budget epsilon=0.62026.02 | 12 | — | — | — | — | |
| MIP-GurobiPerturbation Budget epsilon=0.62026.02 | 12 | 0.443 | — | — | — | |
| QUBO-GurobiPerturbation Budget epsilon=0.62026.02 | 12 | 5,000 | 338.28 | 531 | 196 | |
| QUBO-CIMPerturbation Budget epsilon=0.62026.02 | 12 | 8.489 | 338.28 | 531 | 196 |