Object Detection Robustness on PASCAL VOC 2007 (test)
27.9ASR (FRCNN)EBAD
Evaluation results
| Method | Links | |||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| EBADPerturbation Budget=l_inf = 10, Weight Balancing=false, Weight Optimization=false2023.03 | 27.9 | — | — | — | — | — | — | — | 91.5 | 11.6 | 9.2 | 9 | 13.4 | 5.6 | — | — | — | — | — | |
| EBADPerturbation Budget=l_inf = 20, Weight Balancing=false, Weight Optimization=false2023.03 | 40.1 | — | — | — | — | — | — | — | 92.2 | 16.9 | 20.4 | 15.4 | 23.2 | 9.7 | — | — | — | — | — | |
| EBADPerturbation Budget=l_inf = 30, Weight Balancing=false, Weight Optimization=false2023.03 | 43.4 | — | — | — | — | — | — | — | 91.1 | 17.1 | 22.6 | 17.4 | 27.2 | 11.4 | — | — | — | — | — | |
| Context-aware AttackPerturbation Budget=l_inf = 102023.03 | 55.8 | — | — | — | — | — | — | — | 75.6 | 22.6 | 20.4 | 33.6 | 39.2 | 20.2 | — | — | — | — | — | |
| EBADPerturbation Budget=l_inf = 10, Weight Balancing=false, Weight Optimization=true2023.03 | 61.4 | — | — | — | — | — | — | — | 99.4 | 24.3 | 28 | 22.4 | 31 | 15.4 | — | — | — | — | — | |
| EBADPerturbation Budget=l_inf = 10, Weight Balancing=true, Weight Optimization=false2023.03 | 71.1 | — | — | — | — | — | — | — | 85.7 | 30.9 | 33.4 | 27.2 | 36 | 12.2 | — | — | — | — | — | |
| EBADPerturbation Budget=l_inf = 20, Weight Balancing=false, Weight Optimization=true2023.03 | 77.7 | — | — | — | — | — | — | — | 99.8 | 41 | 45.4 | 37.8 | 47 | 22.5 | — | — | — | — | — | |
| Context-aware AttackPerturbation Budget=l_inf = 202023.03 | 78.6 | — | — | — | — | — | — | — | 87.2 | 35.2 | 38.4 | 51.6 | 56.6 | 34 | — | — | — | — | — | |
| Context-aware AttackPerturbation Budget=l_inf = 302023.03 | 80.6 | — | — | — | — | — | — | — | 88 | 42 | 44.2 | 56.8 | 63.6 | 40.2 | — | — | — | — | — | |
| EBADPerturbation Budget=l_inf = 20, Weight Balancing=true, Weight Optimization=false2023.03 | 82.7 | — | — | — | — | — | — | — | 89.8 | 41 | 50.4 | 44.8 | 57 | 21.6 | — | — | — | — | — | |
| EBADPerturbation Budget=l_inf = 30, Weight Balancing=false, Weight Optimization=true2023.03 | 82.7 | — | — | — | — | — | — | — | 99.6 | 47.2 | 54.8 | 47 | 57.4 | 33.4 | — | — | — | — | — | |
| EBADPerturbation Budget=l_inf = 30, Weight Balancing=true, Weight Optimization=false2023.03 | 85.3 | — | — | — | — | — | — | — | 90.2 | 48.8 | 56.8 | 45.6 | 59.6 | 29.2 | — | — | — | — | — | |
| EBADPerturbation Budget=l_inf = 10, Weight Balancing=true, Weight Optimization=true2023.03 | 86 | — | — | — | — | — | — | — | 96.9 | 53.2 | 56.6 | 47.2 | 57.4 | 29 | — | — | — | — | — | |
| EBADPerturbation Budget=l_inf = 20, Weight Balancing=true, Weight Optimization=true2023.03 | 94.6 | — | — | — | — | — | — | — | 98 | 66.9 | 74.4 | 68 | 79.4 | 48 | — | — | — | — | — | |
| EBADPerturbation Budget=l_inf = 30, Weight Balancing=true, Weight Optimization=true2023.03 | 96 | — | — | — | — | — | — | — | 98.1 | 78.9 | 82.8 | 76.8 | 83 | 58.8 | — | — | — | — | — | |
| CLSBackbone=VGG16-BN, Attack Budget (ϵ)=82021.03 | — | 46.7 | 30.9 | 34.3 | 23.6 | 33.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CWATBackbone=VGG16-BN, Attack Budget (ϵ)=82021.03 | — | 51.3 | 32.5 | 43.3 | 22.4 | 36.7 | 19.9 | 50.3 | — | — | — | — | — | — | — | — | — | — | — | |
| LipSSDAttack budget (ε)=3.0, Backbone=VGG16, Input size=300x3002026.07 | — | 56.6 | — | — | — | — | — | 25.7 | — | — | — | — | — | — | 16.6 | 33.2 | 41.4 | 37.4 | 52 | |
| MTD-fastBackbone=VGG16-BN, Attack Budget (ϵ)=82021.03 | — | 46.6 | 31.1 | 41.8 | 22.1 | 35.1 | 18.2 | 48.6 | — | — | — | — | — | — | — | — | — | — | — | |
| OWATBackbone=VGG16-BN, Attack Budget (ϵ)=82021.03 | — | 51.8 | 32.7 | 43.4 | 22.9 | 37.2 | 20.3 | 50.4 | — | — | — | — | — | — | — | — | — | — | — | |
| REGBackbone=VGG16-BN, Attack Budget (ϵ)=82021.03 | — | 51.9 | 26.3 | 34.4 | 14.6 | 27.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SLipSSDAttack budget (ε)=3.0, Backbone=VGG16, Input size=300x3002026.07 | — | 65.1 | — | — | — | — | — | 7 | — | — | — | — | — | — | 7.4 | 16.4 | 24.1 | 19.5 | 40 | |
| SSDAttack budget (ε)=3.0, Backbone=VGG16, Input size=300x3002026.07 | — | 78.7 | — | — | — | — | — | 0 | — | — | — | — | — | — | 1.8 | 2.6 | 1.9 | 2.2 | 1.2 | |
| STDBackbone=VGG16-BN, Attack Budget (ϵ)=82021.03 | — | 75.2 | 16.2 | 25 | 1.2 | 4.3 | 0.6 | 29.1 | — | — | — | — | — | — | — | — | — | — | — | |
| TOAT-6Backbone=VGG16-BN, Attack Budget (ϵ)=82021.03 | — | 43 | 30 | 39.7 | 21.8 | 33.4 | 19.7 | 46.6 | — | — | — | — | — | — | — | — | — | — | — |