Adversarial Attack on COCO 2017 (val)
44Success Rate (T)GLOW
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| GLOWAttack Setting=White-box, Similarity Constraint=R2-952023.02 | 44 | 69 | 32 | — | — | — | — | |
| GLOWAttack Setting=Zero query black-box, Similarity Constraint=R2-952023.02 | 44 | 29 | 5 | — | — | — | — | |
| GLOWAttack Setting=White-box, Similarity Constraint=R2-502023.02 | 40 | 67 | 35 | — | — | — | — | |
| GLOWAttack Setting=White-box, Similarity Constraint=R2-52023.02 | 38 | 64 | 32 | — | — | — | — | |
| GLOWAttack Setting=Zero query black-box, Similarity Constraint=R2-502023.02 | 38 | 22 | 4 | — | — | — | — | |
| GLOWAttack Setting=Zero query black-box, Similarity Constraint=R2-52023.02 | 37 | 17 | 3 | — | — | — | — | |
| GLOWSetting=Zero query black-box, Attack Scenario=R3-952023.02 | 37 | — | — | — | — | 4 | 1 | |
| GLOWSetting=White-box, Attack Scenario=R3-952023.02 | 35 | — | — | — | — | 53 | 14 | |
| GLOWSetting=White-box, Attack Scenario=R3-502023.02 | 34 | — | — | — | — | 52 | 15 | |
| GLOWSetting=Zero query black-box, Attack Scenario=R3-502023.02 | 34 | — | — | — | — | 4 | 1 | |
| GLOWSetting=White-box, Attack Scenario=R3-52023.02 | 32 | — | — | — | — | 48 | 13 | |
| GLOWSetting=Zero query black-box, Attack Scenario=R3-52023.02 | 31 | — | — | — | — | 2 | 1 | |
| CaiAttack Setting=Zero query black-box, Similarity Constraint=R2-952023.02 | 30 | 20 | 2 | — | — | — | — | |
| CaiSetting=Zero query black-box, Attack Scenario=R3-952023.02 | 30 | — | — | — | — | 2 | 0 | |
| TOG+RANDAttack Setting=Zero query black-box, Similarity Constraint=R2-952023.02 | 29 | 14 | 3 | — | — | — | — | |
| TOGAttack Setting=Zero query black-box, Similarity Constraint=R2-952023.02 | 28 | 12 | 3 | — | — | — | — | |
| TOGSetting=Zero query black-box, Attack Scenario=R3-952023.02 | 28 | — | — | — | — | 4 | 2 | |
| TOG+RANDSetting=Zero query black-box, Attack Scenario=R3-952023.02 | 28 | — | — | — | — | 4 | 1 | |
| TOG+SAMEAttack Setting=Zero query black-box, Similarity Constraint=R2-952023.02 | 27 | 25 | 5 | — | — | — | — | |
| TOG+SAMESetting=Zero query black-box, Attack Scenario=R3-952023.02 | 27 | — | — | — | — | 3 | 2 | |
| CaiAttack Setting=Zero query black-box, Similarity Constraint=R2-52023.02 | 26 | 10 | 2 | — | — | — | — | |
| TOGAttack Setting=Zero query black-box, Similarity Constraint=R2-52023.02 | 25 | 4 | 1 | — | — | — | — | |
| CaiAttack Setting=Zero query black-box, Similarity Constraint=R2-502023.02 | 25 | 15 | 2 | — | — | — | — | |
| CaiSetting=Zero query black-box, Attack Scenario=R3-52023.02 | 25 | — | — | — | — | 1 | 0 | |
| CaiSetting=Zero query black-box, Attack Scenario=R3-502023.02 | 25 | — | — | — | — | 1 | 1 | |
| CaiAttack Setting=White-box, Similarity Constraint=R2-952023.02 | 24 | 53 | 9 | — | — | — | — | |
| TOGAttack Setting=Zero query black-box, Similarity Constraint=R2-502023.02 | 24 | 8 | 2 | — | — | — | — | |
| TOG+SAMEAttack Setting=White-box, Similarity Constraint=R2-952023.02 | 23 | 55 | 20 | — | — | — | — | |
| TOG+SAMEAttack Setting=Zero query black-box, Similarity Constraint=R2-52023.02 | 23 | 12 | 2 | — | — | — | — | |
| CaiSetting=White-box, Attack Scenario=R3-952023.02 | 23 | — | — | — | — | 21 | 2 | |
| TOGAttack Setting=White-box, Similarity Constraint=R2-952023.02 | 22 | 49 | 25 | — | — | — | — | |
| TOG+RANDAttack Setting=White-box, Similarity Constraint=R2-952023.02 | 22 | 32 | 6 | — | — | — | — | |
| TOG+SAMEAttack Setting=Zero query black-box, Similarity Constraint=R2-502023.02 | 22 | 20 | 3 | — | — | — | — | |
| TOGSetting=White-box, Attack Scenario=R3-952023.02 | 22 | — | — | — | — | 50 | 14 | |
| TOG+RANDSetting=White-box, Attack Scenario=R3-952023.02 | 22 | — | — | — | — | 38 | 12 | |
| TOG+SAMESetting=White-box, Attack Scenario=R3-952023.02 | 22 | — | — | — | — | 17 | 12 | |
| TOG+RANDSetting=Zero query black-box, Attack Scenario=R3-52023.02 | 22 | — | — | — | — | 1 | 0 | |
| TOG+SAMESetting=Zero query black-box, Attack Scenario=R3-502023.02 | 22 | — | — | — | — | 2 | 1 | |
| CaiAttack Setting=White-box, Similarity Constraint=R2-52023.02 | 21 | 44 | 11 | — | — | — | — | |
| CaiSetting=White-box, Attack Scenario=R3-502023.02 | 21 | — | — | — | — | 22 | 2 | |
| TOGSetting=Zero query black-box, Attack Scenario=R3-52023.02 | 21 | — | — | — | — | 1 | 0 | |
| TOG+SAMESetting=Zero query black-box, Attack Scenario=R3-52023.02 | 21 | — | — | — | — | 1 | 0 | |
| TOGSetting=Zero query black-box, Attack Scenario=R3-502023.02 | 21 | — | — | — | — | 3 | 1 | |
| TOG+RANDSetting=Zero query black-box, Attack Scenario=R3-502023.02 | 21 | — | — | — | — | 2 | 1 | |
| TOGAttack Setting=White-box, Similarity Constraint=R2-502023.02 | 20 | 41 | 24 | — | — | — | — | |
| TOG+SAMEAttack Setting=White-box, Similarity Constraint=R2-502023.02 | 20 | 51 | 20 | — | — | — | — | |
| CaiAttack Setting=White-box, Similarity Constraint=R2-502023.02 | 20 | 48 | 11 | — | — | — | — | |
| TOG+RANDAttack Setting=Zero query black-box, Similarity Constraint=R2-52023.02 | 20 | 5 | 1 | — | — | — | — | |
| TOG+RANDAttack Setting=Zero query black-box, Similarity Constraint=R2-502023.02 | 20 | 8 | 1 | — | — | — | — | |
| CaiSetting=White-box, Attack Scenario=R3-52023.02 | 20 | — | — | — | — | 17 | 2 | |
| TOG+SAMESetting=White-box, Attack Scenario=R3-502023.02 | 20 | — | — | — | — | 15 | 12 | |
| TOG+RANDAttack Setting=White-box, Similarity Constraint=R2-52023.02 | 19 | 22 | 4 | — | — | — | — | |
| TOGSetting=White-box, Attack Scenario=R3-502023.02 | 19 | — | — | — | — | 43 | 13 | |
| TOG+RANDSetting=White-box, Attack Scenario=R3-502023.02 | 19 | — | — | — | — | 33 | 11 | |
| TOGAttack Setting=White-box, Similarity Constraint=R2-52023.02 | 18 | 31 | 17 | — | — | — | — | |
| TOG+SAMEAttack Setting=White-box, Similarity Constraint=R2-52023.02 | 18 | 45 | 21 | — | — | — | — | |
| TOG+RANDAttack Setting=White-box, Similarity Constraint=R2-502023.02 | 18 | 27 | 6 | — | — | — | — | |
| TOGSetting=White-box, Attack Scenario=R3-52023.02 | 18 | — | — | — | — | 35 | 10 | |
| TOG+RANDSetting=White-box, Attack Scenario=R3-52023.02 | 18 | — | — | — | — | 27 | 8 | |
| TOG+SAMESetting=White-box, Attack Scenario=R3-52023.02 | 18 | — | — | — | — | 14 | 11 | |
| CaiSetting=White-box, Target Label Scenario=R1-52023.02 | — | — | — | 86 | 9 | — | — | |
| CaiSetting=White-box, Target Label Scenario=R1-502023.02 | — | — | — | 87 | 9 | — | — | |
| CaiSetting=White-box, Target Label Scenario=R1-952023.02 | — | — | — | 90 | 7 | — | — | |
| CaiSetting=Zero query black-box, Target Label Scenario=R1-52023.02 | — | — | — | 18 | 1 | — | — | |
| CaiSetting=Zero query black-box, Target Label Scenario=R1-502023.02 | — | — | — | 29 | 2 | — | — | |
| CaiSetting=Zero query black-box, Target Label Scenario=R1-952023.02 | — | — | — | 34 | 2 | — | — | |
| GLOWSetting=White-box, Target Label Scenario=R1-52023.02 | — | — | — | 85 | 20 | — | — | |
| GLOWSetting=White-box, Target Label Scenario=R1-502023.02 | — | — | — | 87 | 22 | — | — | |
| GLOWSetting=White-box, Target Label Scenario=R1-952023.02 | — | — | — | 89 | 21 | — | — | |
| GLOWSetting=Zero query black-box, Target Label Scenario=R1-52023.02 | — | — | — | 21 | 2 | — | — | |
| GLOWSetting=Zero query black-box, Target Label Scenario=R1-502023.02 | — | — | — | 30 | 3 | — | — | |
| GLOWSetting=Zero query black-box, Target Label Scenario=R1-952023.02 | — | — | — | 35 | 4 | — | — | |
| TOGSetting=White-box, Target Label Scenario=R1-52023.02 | — | — | — | 64 | 11 | — | — | |
| TOGSetting=White-box, Target Label Scenario=R1-502023.02 | — | — | — | 75 | 15 | — | — | |
| TOGSetting=White-box, Target Label Scenario=R1-952023.02 | — | — | — | 83 | 20 | — | — | |
| TOGSetting=Zero query black-box, Target Label Scenario=R1-52023.02 | — | — | — | 8 | 1 | — | — | |
| TOGSetting=Zero query black-box, Target Label Scenario=R1-502023.02 | — | — | — | 16 | 2 | — | — | |
| TOGSetting=Zero query black-box, Target Label Scenario=R1-952023.02 | — | — | — | 23 | 3 | — | — | |
| TOG+RANDSetting=White-box, Target Label Scenario=R1-52023.02 | — | — | — | 45 | 6 | — | — | |
| TOG+RANDSetting=White-box, Target Label Scenario=R1-502023.02 | — | — | — | 54 | 8 | — | — | |
| TOG+RANDSetting=White-box, Target Label Scenario=R1-952023.02 | — | — | — | 58 | 7 | — | — | |
| TOG+RANDSetting=Zero query black-box, Target Label Scenario=R1-52023.02 | — | — | — | 12 | 1 | — | — | |
| TOG+RANDSetting=Zero query black-box, Target Label Scenario=R1-502023.02 | — | — | — | 21 | 3 | — | — | |
| TOG+RANDSetting=Zero query black-box, Target Label Scenario=R1-952023.02 | — | — | — | 27 | 4 | — | — | |
| TOG+SAMESetting=White-box, Target Label Scenario=R1-52023.02 | — | — | — | 89 | 18 | — | — | |
| TOG+SAMESetting=White-box, Target Label Scenario=R1-502023.02 | — | — | — | 90 | 18 | — | — | |
| TOG+SAMESetting=White-box, Target Label Scenario=R1-952023.02 | — | — | — | 91 | 18 | — | — | |
| TOG+SAMESetting=Zero query black-box, Target Label Scenario=R1-52023.02 | — | — | — | 21 | 1 | — | — | |
| TOG+SAMESetting=Zero query black-box, Target Label Scenario=R1-502023.02 | — | — | — | 34 | 3 | — | — | |
| TOG+SAMESetting=Zero query black-box, Target Label Scenario=R1-952023.02 | — | — | — | 38 | 3 | — | — |