Object Detection on MS COCO (test)
63.3APNo Attack
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| No AttackSurrogate Model=None, Victim Model=D2ETR2022.09 | 63.3 | — | — | — | — | — | — | — | — | — | |
| No AttackSurrogate Model=None, Victim Model=DETR2022.09 | 60.7 | — | — | — | — | — | — | — | — | — | |
| No AttackSurrogate Model=None, Victim Model=FRCN2022.09 | 58.2 | — | — | — | — | — | — | — | — | — | |
| No AttackSurrogate Model=None, Victim Model=RNet2022.09 | 55.4 | — | — | — | — | — | — | — | — | — | |
| RB-FPNBackbone=ResNet-50, Input size=512x5122020.12 | 44.3 | — | 65.1 | — | — | 32.1 | 48.2 | 25.1 | 47.3 | 56.8 | |
| NAS-FPNBackbone=ResNet-50, Input size=1024x10242020.12 | 44.2 | — | — | — | — | — | — | — | — | — | |
| DiRISP Model=ISP [39]2023.07 | 43.3 | — | 63.9 | — | — | — | 46.4 | — | — | — | |
| GAPSurrogate Model=VGG19, Victim Model=FRCN2022.09 | 42.4 | — | — | — | — | — | — | — | — | — | |
| Sequential-tunedISP Model=ISP [39]2023.07 | 42.3 | — | 62.8 | — | — | — | 45.2 | — | — | — | |
| GAPSurrogate Model=VGG19, Victim Model=D2ETR2022.09 | 41 | — | — | — | — | — | — | — | — | — | |
| Attention-awareISP Model=ISP [39]2023.07 | 41 | — | 61 | — | — | — | 44.1 | — | — | — | |
| GAPSurrogate Model=Res152, Victim Model=D2ETR2022.09 | 40.8 | — | — | — | — | — | — | — | — | — | |
| GAPSurrogate Model=VGG19, Victim Model=RNet2022.09 | 40.4 | — | — | — | — | — | — | — | — | — | |
| TAPSurrogate Model=Res152, Victim Model=FRCN2022.09 | 40 | — | — | — | — | — | — | — | — | — | |
| GAPSurrogate Model=Res152, Victim Model=FRCN2022.09 | 38.9 | — | — | — | — | — | — | — | — | — | |
| TAPSurrogate Model=VGG19, Victim Model=FRCN2022.09 | 38.4 | — | — | — | — | — | — | — | — | — | |
| GAPSurrogate Model=Res152, Victim Model=DETR2022.09 | 36.3 | — | — | — | — | — | — | — | — | — | |
| GAPSurrogate Model=Res152, Victim Model=RNet2022.09 | 36.2 | — | — | — | — | — | — | — | — | — | |
| GAPSurrogate Model=VGG19, Victim Model=DETR2022.09 | 36 | — | — | — | — | — | — | — | — | — | |
| TAPSurrogate Model=Res152, Victim Model=D2ETR2022.09 | 35 | — | — | — | — | — | — | — | — | — | |
| TAPSurrogate Model=Res152, Victim Model=RNet2022.09 | 34.8 | — | — | — | — | — | — | — | — | — | |
| BIASurrogate Model=VGG19, Victim Model=FRCN2022.09 | 34.7 | — | — | — | — | — | — | — | — | — | |
| EfficientDet-D0Backbone=EfficientNet [48], Input size=512x5122020.12 | 34.6 | — | 53 | — | — | — | 37.1 | — | — | — | |
| BFMBackbone=VGG16, Input size=512x5122020.12 | 34.6 | — | 58.6 | — | — | 31.4 | 36.7 | 18.6 | 36.5 | 44.3 | |
| TAPSurrogate Model=VGG19, Victim Model=RNet2022.09 | 34 | — | — | — | — | — | — | — | — | — | |
| NIFF-DeFRCNShots=302023.03 | 33.3 | — | — | 37.7 | 20 | — | — | — | — | — | |
| FPN-BPNBackbone=VGG16, Input size=512x5122020.12 | 33.1 | — | 53.1 | — | — | 18.9 | 36.3 | 15.7 | 37 | 44.2 | |
| BIASurrogate Model=Res152, Victim Model=FRCN2022.09 | 32.1 | — | — | — | — | — | — | — | — | — | |
| NIFF-DeFRCNShots=102023.03 | 32.1 | — | — | 36.8 | 18 | — | — | — | — | — | |
| TAPSurrogate Model=VGG19, Victim Model=D2ETR2022.09 | 32 | — | — | — | — | — | — | — | — | — | |
| BIASurrogate Model=VGG19, Victim Model=RNet2022.09 | 31.8 | — | — | — | — | — | — | — | — | — | |
| CFA-DeFRCNShots=302023.03 | 31.7 | — | — | 34.6 | 23 | — | — | — | — | — | |
| DeFRCNShots=302023.03 | 31.4 | — | — | 34.8 | 21.2 | — | — | — | — | — | |
| CFA w/ cosShots=302023.03 | 31.1 | — | — | 36.6 | 14.8 | — | — | — | — | — | |
| NIFF-DeFRCNShots=52023.03 | 31.1 | — | — | 36.6 | 14.6 | — | — | — | — | — | |
| CFA w/ fcShots=302023.03 | 30.8 | — | — | 36.6 | 13.6 | — | — | — | — | — | |
| CDASurrogate Model=Res152, Victim Model=FRCN2022.09 | 30.5 | — | — | — | — | — | — | — | — | — | |
| CFA w/ cosShots=102023.03 | 30.2 | — | — | 36.6 | 11.2 | — | — | — | — | — | |
| CFA-DeFRCNShots=102023.03 | 30.2 | — | — | 34 | 18.8 | — | — | — | — | — | |
| CFA w/ fcShots=102023.03 | 29.9 | — | — | 36.7 | 9.6 | — | — | — | — | — | |
| DeFRCNShots=102023.03 | 29.7 | — | — | 34 | 16.8 | — | — | — | — | — | |
| FPN-BPNBackbone=VGG16, Input size=320x3202020.12 | 29.6 | — | 48.4 | — | — | 32.4 | 32.3 | 9.6 | 32.5 | 44.3 | |
| CFA w/ cosShots=52023.03 | 29.3 | — | — | 36 | 9.2 | — | — | — | — | — | |
| CFA w/ fcShots=52023.03 | 29.1 | — | — | 36.2 | 7.7 | — | — | — | — | — | |
| TAPSurrogate Model=Res152, Victim Model=DETR2022.09 | 28.8 | — | — | — | — | — | — | — | — | — | |
| TFA w/ cosShots=302023.03 | 28.7 | — | — | 34.2 | 12.1 | — | — | — | — | — | |
| TFA w/ fcShots=302023.03 | 28.4 | — | — | 33.8 | 12 | — | — | — | — | — | |
| CFA-DeFRCNShots=52023.03 | 28.4 | — | — | 32.8 | 15.2 | — | — | — | — | — | |
| BIASurrogate Model=VGG19, Victim Model=D2ETR2022.09 | 28.1 | — | — | — | — | — | — | — | — | — | |
| CDASurrogate Model=Res152, Victim Model=D2ETR2022.09 | 28.1 | — | — | — | — | — | — | — | — | — | |
| DeFRCNShots=52023.03 | 27.8 | — | — | 32.6 | 13.6 | — | — | — | — | — | |
| CDASurrogate Model=VGG19, Victim Model=FRCN2022.09 | 27.6 | — | — | — | — | — | — | — | — | — | |
| TAPSurrogate Model=VGG19, Victim Model=DETR2022.09 | 27.5 | — | — | — | — | — | — | — | — | — | |
| BIASurrogate Model=Res152, Victim Model=RNet2022.09 | 27.5 | — | — | — | — | — | — | — | — | — | |
| CDASurrogate Model=Res152, Victim Model=RNet2022.09 | 27.4 | — | — | — | — | — | — | — | — | — | |
| TFA w/ cosShots=102023.03 | 26.6 | — | — | 32.4 | 9.1 | — | — | — | — | — | |
| TFA w/ fcShots=102023.03 | 26.2 | — | — | 32 | 9.1 | — | — | — | — | — | |
| TFA w/ cosShots=52023.03 | 25.9 | — | — | 32.3 | 7 | — | — | — | — | — | |
| CDASurrogate Model=Res152, Victim Model=DETR2022.09 | 25.6 | — | — | — | — | — | — | — | — | — | |
| BIASurrogate Model=Res152, Victim Model=D2ETR2022.09 | 25.6 | — | — | — | — | — | — | — | — | — | |
| TFA w/ fcShots=52023.03 | 25.6 | — | — | 31.8 | 6.9 | — | — | — | — | — | |
| BIASurrogate Model=VGG19, Victim Model=DETR2022.09 | 25.3 | — | — | — | — | — | — | — | — | — | |
| CDASurrogate Model=VGG19, Victim Model=RNet2022.09 | 25 | — | — | — | — | — | — | — | — | — | |
| CDASurrogate Model=VGG19, Victim Model=D2ETR2022.09 | 24.4 | — | — | — | — | — | — | — | — | — | |
| GAMASurrogate Model=VGG19, Victim Model=FRCN2022.09 | 23.4 | — | — | — | — | — | — | — | — | — | |
| Default ParamsISP Model=ISP [39]2023.07 | 21.4 | — | 34.1 | — | — | — | 22.4 | — | — | — | |
| CDASurrogate Model=VGG19, Victim Model=DETR2022.09 | 20.8 | — | — | — | — | — | — | — | — | — | |
| GAMASurrogate Model=VGG19, Victim Model=RNet2022.09 | 20.7 | — | — | — | — | — | — | — | — | — | |
| BIASurrogate Model=Res152, Victim Model=DETR2022.09 | 20.5 | — | — | — | — | — | — | — | — | — | |
| GAMASurrogate Model=Res152, Victim Model=FRCN2022.09 | 17.2 | — | — | — | — | — | — | — | — | — | |
| GAMASurrogate Model=Res152, Victim Model=RNet2022.09 | 13.8 | — | — | — | — | — | — | — | — | — | |
| Ranking GAN (Ours_VGG)Backbone=VGG, Detection Framework=SSD2017.11 | 13.6 | — | — | — | — | — | — | — | — | — | |
| Ranking GAN (Ours_VGG)Backbone=VGG, Detection Framework=FRCNN2017.11 | 12.8 | — | — | — | — | — | — | — | — | — | |
| WCCNBackbone=VGG162017.11 | 12.3 | — | — | — | — | — | — | — | — | — | |
| GAMASurrogate Model=VGG19, Victim Model=D2ETR2022.09 | 12.2 | — | — | — | — | — | — | — | — | — | |
| GAMASurrogate Model=VGG19, Victim Model=DETR2022.09 | 11.7 | — | — | — | — | — | — | — | — | — | |
| WSDDN2017.11 | 11.5 | — | — | — | — | — | — | — | — | — | |
| Ranking GAN (Ours_AlexNet)Backbone=AlexNet, Detection Framework=FRCNN2017.11 | 10.9 | — | — | — | — | — | — | — | — | — | |
| WCCNBackbone=AlexNet2017.11 | 10.1 | — | — | — | — | — | — | — | — | — | |
| GAMASurrogate Model=Res152, Victim Model=D2ETR2022.09 | 9.5 | — | — | — | — | — | — | — | — | — | |
| GAMASurrogate Model=Res152, Victim Model=DETR2022.09 | 8 | — | — | — | — | — | — | — | — | — | |
| Blockwise-tunedISP Model=ISP [32]2023.07 | — | — | 20 | — | — | — | — | — | — | — | |
| CSPDenseNet Ref.-EFM (SAM)Size=320, GPU FPS=235, mGPU FPS=492019.11 | — | — | 42.2 | — | — | — | — | — | — | — | |
| CSPDenseNet Ref.-PRNSize=320, GPU FPS=387, CPU FPS=95, mGPU FPS=642019.11 | — | — | 35.4 | — | — | — | — | — | — | — | |
| CSPDenseNetb Ref.-PRNSize=320, GPU FPS=400, CPU FPS=102, mGPU FPS=732019.11 | — | — | 34.2 | — | — | — | — | — | — | — | |
| CSPPeleeNet Ref.-EFM (SAM)Size=320, GPU FPS=205, mGPU FPS=412019.11 | — | — | 44.6 | — | — | — | — | — | — | — | |
| CSPPeleeNet Ref.-PRNSize=320, GPU FPS=306, CPU FPS=75, mGPU FPS=522019.11 | — | — | 38.5 | — | — | — | — | — | — | — | |
| CSPPeleeNet Ref.-PRN (31)Size=320, GPU FPS=267, CPU FPS=52, mGPU FPS=382019.11 | — | — | 40 | — | — | — | — | — | — | — | |
| Default ParamsISP Model=ISP [32]2023.07 | — | — | 15 | — | — | — | — | — | — | — | |
| GBFPN-SSDBackbone=VGG16, Input size=512x5122020.12 | — | — | — | — | — | 33 | — | — | — | — | |
| Hardware-tunedISP Model=ISP [32]2023.07 | — | — | 39 | — | — | — | — | — | — | — | |
| Mask-RCNNBackbone=ResNet50, Detector=Mask-RCNN2019.09 | — | 38.2 | — | — | — | — | — | — | — | — | |
| Mask-RCNNBackbone=ResNet101, Detector=Mask-RCNN2019.09 | — | 40.2 | — | — | — | — | — | — | — | — | |
| Mask-RCNN + CGNLBackbone=ResNet50, Detector=Mask-RCNN + CGNL2019.09 | — | 38.9 | — | — | — | — | — | — | — | — | |
| Mask-RCNN + GALDBackbone=ResNet50, Detector=Mask-RCNN + GALD2019.09 | — | 39.2 | — | — | — | — | — | — | — | — | |
| Mask-RCNN + GALDBackbone=ResNet101, Detector=Mask-RCNN + GALD2019.09 | — | 41.1 | — | — | — | — | — | — | — | — | |
| Mask-RCNN + NLBackbone=ResNet50, Detector=Mask-RCNN + NL2019.09 | — | 39 | — | — | — | — | — | — | — | — | |
| Mask-RCNN + NLBackbone=ResNet101, Detector=Mask-RCNN + NL2019.09 | — | 40.9 | — | — | — | — | — | — | — | — | |
| SNet146-ThunderSize=320, GPU FPS=248, CPU FPS=322019.11 | — | — | 40.2 | — | — | — | — | — | — | — | |
| SNet49-ThunderSize=320, GPU FPS=267, CPU FPS=472019.11 | — | — | 33.7 | — | — | — | — | — | — | — |