Object Detection on MS-COCO 2017 (val)
74mAPSAM-H Baseline
Evaluation results
| Method | Links | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SAM-H BaselineModel=SAM-H, Quantization=FP2026.05 | 74 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SAM-B BaselineModel=SAM-B, Quantization=FP2026.05 | 73.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SAM-L BaselineModel=SAM-L, Quantization=FP2026.05 | 73.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BRECQModel=SAM-B, Quantization=W6A62026.05 | 73.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PTQ4SAMModel=SAM-H, Quantization=W6A62026.05 | 72.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| QDropModel=SAM-L, Quantization=W6A62026.05 | 72.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CAR-SAMModel=SAM-L, Quantization=W6A62026.05 | 72.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PTQ4SAMModel=SAM-L, Quantization=W6A62026.05 | 72.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CAR-SAMModel=SAM-H, Quantization=W6A62026.05 | 72.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CAR-SAMModel=SAM-B, Quantization=W6A62026.05 | 72 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| QDropModel=SAM-H, Quantization=W6A62026.05 | 72 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PTQ4SAMModel=SAM-B, Quantization=W6A62026.05 | 70.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BRECQModel=SAM-L, Quantization=W6A62026.05 | 70.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| QDropModel=SAM-B, Quantization=W6A62026.05 | 69.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BRECQModel=SAM-H, Quantization=W6A62026.05 | 69.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CAR-SAMModel=SAM-H, Quantization=W4A42026.05 | 66.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CAR-SAMModel=SAM-L, Quantization=W4A42026.05 | 65.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PTQ4SAMModel=SAM-H, Quantization=W4A42026.05 | 64 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| QDropModel=SAM-H, Quantization=W4A42026.05 | 63.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CAR-SAMModel=SAM-B, Quantization=W4A42026.05 | 60.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PTQ4SAMModel=SAM-L, Quantization=W4A42026.05 | 58.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DETRBackbone=DC5-R101, Dilation (DC5)=true, Condition=Clean2022.03 | 56.74 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| QDropModel=SAM-L, Quantization=W4A42026.05 | 56 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DETRBackbone=R101, Dilation (DC5)=false, Condition=Clean2022.03 | 54.41 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DETRBackbone=DC5-R50, Dilation (DC5)=true, Condition=Clean2022.03 | 54.25 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DETRBackbone=R50, Dilation (DC5)=false, Condition=Clean2022.03 | 53 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PTQ4SAMModel=SAM-B, Quantization=W4A42026.05 | 50.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| QDropModel=SAM-B, Quantization=W4A42026.05 | 50.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BRECQModel=SAM-H, Quantization=W4A42026.05 | 49.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Cascade RCNNBackbone=ResNeSt2002020.04 | 49.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BRECQModel=SAM-L, Quantization=W4A42026.05 | 48.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Cascade RCNNBackbone=ResNeSt1012020.04 | 47.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PseCoRemarks=ECCV 2022, Extra Dataset=unlabeled20172023.06 | 46.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MA-GCPRemarks=CVPR 2022, Extra Dataset=unlabeled20172023.06 | 45.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DTG-SSODLabeled Data Ratio=100%2022.07 | 45.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DTG-SSODRemarks=Arxiv 2022, Extra Dataset=unlabeled20172023.06 | 45.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Cascade RCNNBackbone=ResNeSt502020.04 | 45.41 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LabelMatchRemarks=CVPR 2022, Extra Dataset=unlabeled20172023.06 | 45.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Faster RCNNBackbone=ResNeSt1012020.04 | 44.72 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DCSTRemarks=IJCAI 2022, Extra Dataset=unlabeled20172023.06 | 44.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Soft TeacherLabeled Data Ratio=100%2022.07 | 44.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Soft-teacherRemarks=ICCV 2021, Extra Dataset=unlabeled20172023.06 | 44.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Cascade RCNNBackbone=ResNet101 [60]2020.04 | 44.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| OursRemarks=Current Paper, Extra Dataset=unlabeled20172023.06 | 44 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DPT-MediumBackbone=DPT-Medium, Training Schedule=3x, Multi-scale=true, Parameter Count=55.9M2021.07 | 43.7 | — | 64.6 | 46.4 | 27.2 | 47 | 58.4 | — | — | — | — | — | — | — | — | — | — | — | |
| PVT-LargeBackbone=PVT-Large, Training Schedule=3x, Multi-scale=true, Parameter Count=71.1M2021.07 | 43.4 | — | 63.6 | 46.1 | 26.1 | 46 | 59.5 | — | — | — | — | — | — | — | — | — | — | — | |
| SEDLabeled Data Ratio=100%2022.07 | 43.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DPT-MediumBackbone=DPT-Medium, Training Schedule=1x, Multi-scale=false, Parameter Count=55.9M2021.07 | 43.3 | — | 64.6 | 45.9 | 27.2 | 46.7 | 58.6 | — | — | — | — | — | — | — | — | — | — | — | |
| DPT-SmallBackbone=DPT-Small, Training Schedule=3x, Multi-scale=true, Parameter Count=36.1M2021.07 | 43.3 | — | 64 | 46.5 | 27.8 | 46.3 | 58.5 | — | — | — | — | — | — | — | — | — | — | — | |
| Rethinking PseLabeled Data Ratio=100%2022.07 | 43.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CSTRemarks=ACM MM 2022, Extra Dataset=unlabeled20172023.06 | 43.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PVT-MediumBackbone=PVT-Medium, Training Schedule=3x, Multi-scale=true, Parameter Count=53.9M2021.07 | 43.2 | — | 63.8 | 46.1 | 27.3 | 46.3 | 58.9 | — | — | — | — | — | — | — | — | — | — | — | |
| Cascade-RCNNBackbone=ResNet1012020.04 | 42.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PVT-LargeBackbone=PVT-Large, Training Schedule=1x, Multi-scale=false, Parameter Count=71.1M2021.07 | 42.6 | — | 63.7 | 45.4 | 25.8 | 46 | 58.4 | — | — | — | — | — | — | — | — | — | — | — | |
| Cascade RCNNBackbone=ResNet50 [60]2020.04 | 42.52 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DPT-SmallBackbone=DPT-Small, Training Schedule=1x, Multi-scale=false, Parameter Count=36.1M2021.07 | 42.5 | — | 63.6 | 45.3 | 26.2 | 45.7 | 56.9 | — | — | — | — | — | — | — | — | — | — | — | |
| Humble TeacherLabeled Data Ratio=100%2022.07 | 42.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Faster RCNNBackbone=ResNeSt502020.04 | 42.33 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PVT-SmallBackbone=PVT-Small, Training Schedule=3x, Multi-scale=true, Parameter Count=34.2M2021.07 | 42.2 | — | 62.7 | 45 | 26.2 | 45.2 | 57.2 | — | — | — | — | — | — | — | — | — | — | — | |
| DDTRemarks=AAAI 2022, Extra Dataset=unlabeled20172023.06 | 42.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Attention-FoolBackbone=R50, Patch Size=48x48, Loss=Lkq only2022.03 | 42.19 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Faster RCNN + DCNBackbone=ResNet101 [7]2020.04 | 42.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MUMLabeled Data Ratio=100%2022.07 | 42.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PGD AttackBackbone=R50, Patch Size=48x48, Loss=Lce2022.03 | 42.08 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PretrainedModel=DETR, Weight/Activation Bits=32/322022.11 | 42 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Faster RCNNBackbone=SE-ResNet101 [27]2020.04 | 41.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PVT-MediumBackbone=PVT-Medium, Training Schedule=1x, Multi-scale=false, Parameter Count=53.9M2021.07 | 41.9 | — | 63.1 | 44.3 | 25 | 44.9 | 57.6 | — | — | — | — | — | — | — | — | — | — | — | |
| Self-trainingRemarks=NIPS 2020, Extra Dataset=ImageNet+OpenImages2023.06 | 41.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ResNeXt101-64x4dBackbone=ResNeXt101-64x4d, Training Schedule=3x, Multi-scale=true, Parameter Count=95.5M2021.07 | 41.8 | — | 61.5 | 44.4 | 25.2 | 45.4 | 54.6 | — | — | — | — | — | — | — | — | — | — | — | |
| NoisyQuant-LinearModel=DETR, Weight/Activation Bits=8/82022.11 | 41.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Faster RCNNBackbone=ResNet101 [60]2020.04 | 41.37 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PGD AttackBackbone=DC5-R101, Patch Size=48x48, Loss=Lce2022.03 | 41.32 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Unbiased TeacherLabeled Data Ratio=100%2022.07 | 41.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DPT-TinyBackbone=DPT-Tiny, Training Schedule=3x, Multi-scale=true, Parameter Count=24.9M2021.07 | 41.2 | — | 62 | 44 | 25.7 | 44.6 | 53.9 | — | — | — | — | — | — | — | — | — | — | — | |
| Liu et al.Model=DETR, Weight/Activation Bits=8/82022.11 | 41.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ResNeXt101-32x4dBackbone=ResNeXt101-32x4d, Training Schedule=3x, Multi-scale=true, Parameter Count=56.4M2021.07 | 41.1 | — | 61 | 44.3 | 23.9 | 45.5 | 53.7 | — | — | — | — | — | — | — | — | — | — | — | |
| EasyQuantModel=DETR, Weight/Activation Bits=8/82022.11 | 41.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ResNeXt101-64x4dBackbone=ResNeXt101-64x4d, Training Schedule=1x, Multi-scale=false, Parameter Count=95.5M2021.07 | 41 | — | 60.9 | 44 | 23.9 | 45.2 | 54 | — | — | — | — | — | — | — | — | — | — | — | |
| ResNet101Backbone=ResNet101, Training Schedule=3x, Multi-scale=true, Parameter Count=56.7M2021.07 | 40.9 | — | 60.1 | 44 | 23.7 | 45 | 53.8 | — | — | — | — | — | — | — | — | — | — | — | |
| Supervised BaselineLabeled Data Ratio=100%2022.07 | 40.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Bit-SplitModel=DETR, Weight/Activation Bits=8/82022.11 | 40.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PVT-SmallBackbone=PVT-Small, Training Schedule=1x, Multi-scale=false, Parameter Count=34.2M2021.07 | 40.4 | — | 61.3 | 43 | 25 | 42.9 | 55.7 | — | — | — | — | — | — | — | — | — | — | — | |
| Instant-TeachingLabeled Data Ratio=100%2022.07 | 40.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Faster RCNNBackbone=ResNeXt101 [7, 63]2020.04 | 40.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ResNeXt101-32x4dBackbone=ResNeXt101-32x4d, Training Schedule=1x, Multi-scale=false, Parameter Count=56.4M2021.07 | 39.9 | — | 59.6 | 42.7 | 22.3 | 44.2 | 52.5 | — | — | — | — | — | — | — | — | — | — | — | |
| ISMTLabeled Data Ratio=100%2022.07 | 39.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DPT-TinyBackbone=DPT-Tiny, Training Schedule=1x, Multi-scale=false, Parameter Count=24.9M2021.07 | 39.5 | — | 60.4 | 41.8 | 23.7 | 43.2 | 52.2 | — | — | — | — | — | — | — | — | — | — | — | |
| PVT-TinyBackbone=PVT-Tiny, Training Schedule=3x, Multi-scale=true, Parameter Count=23.0M2021.07 | 39.4 | — | 59.8 | 42 | 25.5 | 42 | 52.1 | — | — | — | — | — | — | — | — | — | — | — | |
| Faster RCNNBackbone=ResNet50 [60]2020.04 | 39.25 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| STACLabeled Data Ratio=100%2022.07 | 39.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ResNet50Backbone=ResNet50, Training Schedule=3x, Multi-scale=true, Parameter Count=37.7M2021.07 | 39 | — | 58.4 | 41.8 | 22.4 | 42.8 | 51.6 | — | — | — | — | — | — | — | — | — | — | — | |
| PercentileModel=DETR, Weight/Activation Bits=8/82022.11 | 38.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ResNet101Backbone=ResNet101, Training Schedule=1x, Multi-scale=false, Parameter Count=56.7M2021.07 | 38.5 | — | 57.8 | 41.2 | 21.4 | 42.6 | 51.1 | — | — | — | — | — | — | — | — | — | — | — | |
| PGD AttackBackbone=DC5-R101, Patch Size=56x56, Loss=Lce2022.03 | 38.28 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Attention-FoolBackbone=R50, Patch Size=56x56, Loss=Lkq only2022.03 | 38.14 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PGD AttackBackbone=R101, Patch Size=48x48, Loss=Lce2022.03 | 37.89 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PGD AttackBackbone=R50, Patch Size=56x56, Loss=Lce2022.03 | 37.74 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DPT-SmallBackbone=DPT-Small, Framework=DETR, Training Epochs=502021.07 | 37.7 | — | 59.2 | 38.8 | 15 | 40.3 | 58.5 | — | — | — | — | — | — | — | — | — | — | — | |
| Proposed MethodBackbone=ResNet-50, Detector=Faster R-CNN, Training Iterations=180k, Data Sampling Ratio=0.22023.06 | 37.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Faster RCNNBackbone=ResNet101 [22]2020.04 | 37.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — |