Panoptic Segmentation on COCO (test-dev)
56.2PQPanoptic SegFormer
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Panoptic SegFormerBackbone=Swin-L2021.09 | 56.2 | 82.8 | 67.1 | 62.3 | — | — | 47 | — | — | |
| Panoptic SegFormerBackbone=PVTv2-B5, Pre-trained on ImageNet-22K=true2021.09 | 55.8 | 83 | 66.5 | 61.9 | — | — | 46.5 | — | — | |
| CMT-DeepLabbackbone=Axial-R104-RFN, params=270.3M, pre-training=ImageNet-22K, training iterations=200k2022.06 | 55.7 | 83.6 | 65.9 | 61.6 | — | — | 46.8 | — | — | |
| CMT-DeepLabbackbone=Axial-R104-RFN, params=270.3M, pre-training=ImageNet-22K2022.06 | 55.4 | 83.5 | 65.6 | 61 | — | — | 47 | — | — | |
| K-NetBackbone=Swin-L, Pre-trained on ImageNet-22K=true2021.09 | 55.2 | 82.4 | 66.1 | 61.2 | — | — | 46.2 | — | — | |
| K-Netbackbone=Swin-L, pre-training=ImageNet-22K2022.06 | 55.2 | 82.4 | 66.1 | 61.2 | — | — | 46.2 | — | — | |
| CMT-DeepLabbackbone=Axial-R104, params=135.2M, pre-training=ImageNet-22K2022.06 | 54.5 | 83.2 | 64.7 | 59.6 | — | — | 46.9 | — | — | |
| InnovationBackbone=ensemble2021.09 | 53.5 | 83.4 | 63.3 | 61.8 | — | — | 41.1 | — | — | |
| CMT-DeepLabbackbone=Axial-R50, params=94.9M, pre-training=ImageNet-22K2022.06 | 53.4 | 83 | 63.6 | 58.3 | — | — | 46 | — | — | |
| MaskFormerBackbone=Swin-L, Pre-trained on ImageNet-22K=true2021.09 | 53.3 | 82 | 64.1 | 59.1 | — | — | 44.5 | — | — | |
| MaskFormerbackbone=Swin-L, params=212M, pre-training=ImageNet-22K2022.06 | 53.3 | 82 | 64.1 | 59.1 | — | — | 44.5 | — | — | |
| Megvii (Face++)backbone=ensemble model2019.01 | 53.2 | 83.2 | 62.9 | 62.2 | 85.5 | 72.5 | 39.5 | 79.7 | 48.5 | |
| MaX-DeepLab-LBackbone=MaX-L, TTA=false2020.12 | 51.3 | — | — | 57.2 | — | — | 42.4 | — | — | |
| Max-Deeplab-LBackbone=Max-L2021.09 | 51.3 | 82.5 | 61.3 | 57.2 | — | — | 42.4 | — | — | |
| MaX-DeepLab-Lbackbone=MaX-L, params=451M2022.06 | 51.3 | 82.5 | 61.3 | 57.2 | — | — | 42.4 | — | — | |
| Panoptic SegFormerBackbone=R1012021.09 | 50.9 | 82 | 61.2 | 56.2 | — | — | 43 | — | — | |
| Panoptic SegFormerBackbone=R502021.09 | 50.2 | 81.9 | 60.4 | 55.3 | — | — | 42.4 | — | — | |
| DetectoRSTTA=true2020.06 | 50 | — | — | 58.5 | — | — | 37.2 | — | — | |
| DetectoRSBackbone=ResNeXt-101, MS=true2020.11 | 49.6 | — | — | 57.8 | — | — | 37.1 | — | — | |
| DetectoRSBackbone=RX-101, TTA=true2020.12 | 49.6 | — | — | 57.8 | — | — | 37.1 | — | — | |
| MaX-DeepLab-SBackbone=MaX-S, TTA=false2020.12 | 49 | — | — | 54 | — | — | 41.6 | — | — | |
| MaX-DeepLab-Sbackbone=MaX-S, params=61.9M2022.06 | 49 | — | — | 54 | — | — | 41.6 | — | — | |
| Ada-Segmentbackbone=ResNet-101-FPN-D2020.12 | 48.5 | 81.8 | 58.2 | 55.7 | — | — | 37.6 | — | — | |
| SOGNetBackbone=DCN-101, Multi-scale=true2020.03 | 47.8 | — | — | — | — | — | — | — | — | |
| SOGNetTTA=true2020.06 | 47.8 | — | — | — | — | — | — | — | — | |
| SOGNetbackbone=ResNet-101-FPN-D2020.12 | 47.8 | 80.7 | 57.6 | — | — | — | — | — | — | |
| SOGNetBackbone=DCN-101, MS=true2020.11 | 47.8 | — | — | — | — | — | — | — | — | |
| Panoptic FCNParadigm=box-free, Backbone=DCN101-FPN, Simple enhanced version=true, val set for training=true2020.12 | 47.5 | — | — | 53.7 | — | — | 38.2 | — | — | |
| SpatialFlowBackbone=DCN-101, Multi-scale=true2020.03 | 47.3 | — | — | 53.5 | — | — | 37.9 | — | — | |
| SpatialFlowTTA=true2020.06 | 47.3 | — | — | 53.5 | — | — | 37.9 | — | — | |
| SpatialFlowbackbone=ResNet-101-FPN-D2020.12 | 47.3 | 81.8 | 56.9 | 53.5 | — | — | 37.9 | — | — | |
| BANetbackbone=ResNet-101-FPN-D2020.12 | 47.3 | 80.8 | 57.5 | 54.9 | — | — | 35.9 | — | — | |
| SpatialFlowBackbone=DCN-101, MS=true2020.11 | 47.3 | — | — | 53.5 | — | — | 37.9 | — | — | |
| BANetParadigm=box-based, Backbone=DCN101-FPN2020.12 | 47.3 | — | — | 54.9 | — | — | 35.9 | — | — | |
| Li et al.Backbone=DCN-101, Multi-scale=true2020.03 | 47.2 | — | — | 53.5 | — | — | 37.7 | — | — | |
| Li et al.TTA=false2020.06 | 47.2 | — | — | 53.5 | — | — | 37.7 | — | — | |
| Li et al.Backbone=DCN-101, MS=true2020.11 | 47.2 | — | — | 53.5 | — | — | 37.7 | — | — | |
| Unifying+Paradigm=box-based, Backbone=DCN101-FPN2020.12 | 47.2 | — | — | 53.5 | — | — | 37.7 | — | — | |
| Panoptic FCNParadigm=box-free, Backbone=DCN101-FPN, Simple enhanced version=true2020.12 | 47.1 | — | — | 53.2 | — | — | 37.8 | — | — | |
| Panoptic FCNParadigm=box-free, Backbone=DCN101-FPN2020.12 | 47 | — | — | 53 | — | — | 37.8 | — | — | |
| Caribbeanbackbone=ensemble model2019.01 | 46.8 | 80.5 | 57.1 | 54.3 | 81.8 | 65.9 | 35.5 | 78.5 | 43.8 | |
| OCFusionBackbone=ResNeXt-101, Multi-scale testing=true, Deformable convolution=true2019.06 | 46.7 | — | — | 54 | — | — | 35.7 | — | — | |
| OCFusionbackbone=ResNeXt-101-FPN-D2020.12 | 46.7 | — | — | 54 | — | — | 35.7 | — | — | |
| Panoptic-DeepLabBackbone=SWideRNet-(1, 1, 4), MS=true2020.11 | 46.7 | — | — | 52.2 | — | — | 38.3 | — | — | |
| UPSNetbackbone=ResNet-101-FPN2019.01 | 46.6 | 80.5 | 56.9 | 53.2 | 81.5 | 64.6 | 36.7 | 78.9 | 45.3 | |
| UPSNet-msBackbone=ResNet-101-FPN, Multi-scale test=true2019.09 | 46.6 | — | — | 53.2 | — | — | 36.7 | — | — | |
| UPSNetBackbone=DCN-101, Flip=true, MS=true2019.11 | 46.6 | — | — | 53.2 | — | — | 36.7 | — | — | |
| UPSNetBackbone=ResNet-101, Multi-scale testing=true, Deformable convolution=true2019.06 | 46.6 | — | — | 53.2 | — | — | 36.7 | — | — | |
| UPSNetBackbone=DCN-101, Multi-scale=true2020.03 | 46.6 | — | — | 53.2 | — | — | 36.7 | — | — | |
| UPSNetTTA=true2020.06 | 46.6 | — | — | 53.2 | — | — | 36.7 | — | — | |
| UPSNetbackbone=ResNet-101-FPN-D2020.12 | 46.6 | 80.5 | 56.9 | 53.2 | — | — | 36.7 | — | — | |
| UPSNetBackbone=DCN-101, MS=true2020.11 | 46.6 | — | — | 53.2 | — | — | 36.7 | — | — | |
| UPSNetParadigm=box-based, Backbone=DCN101-FPN2020.12 | 46.6 | — | — | 53.2 | — | — | 36.7 | — | — | |
| UPSNetStage=Two Stage, Backbone=ResNet-101-FPN, Flip=true, MS=true2020.03 | 46.6 | — | — | 53.2 | — | — | 36.7 | — | — | |
| UPSNetBackbone=DCN-101, TTA=true2020.12 | 46.6 | — | — | 53.2 | — | — | 36.7 | — | — | |
| AUNetbackbone=ResNeXt-152-FPN2019.01 | 46.5 | 81 | 56.1 | 55.9 | 83.7 | 66.3 | 32.5 | 77 | 40.7 | |
| AUNetBackbone=ResNeXt-152-FPN2019.09 | 46.5 | — | — | 55.9 | — | — | 32.5 | — | — | |
| AUNetBackbone=ResNeXt-152, Flip=false, MS=false2019.11 | 46.5 | — | — | 55.8 | — | — | 32.5 | — | — | |
| AUNetBackbone=ResNeXt-152, Multi-scale testing=true, Deformable convolution=false2019.06 | 46.5 | — | — | 55.9 | — | — | 32.5 | — | — | |
| AUNetBackbone=ResNeXt-152, Multi-scale=false2020.03 | 46.5 | — | — | 55.8 | — | — | 32.5 | — | — | |
| AUNetTTA=false2020.06 | 46.5 | — | — | 55.8 | — | — | 32.5 | — | — | |
| AUNetbackbone=ResNeXt-152-FPN-D2020.12 | 46.5 | 81 | 56.1 | 55.8 | — | — | 32.5 | — | — | |
| AUNetBackbone=ResNeXt-152, MS=false2020.11 | 46.5 | — | — | 55.8 | — | — | 32.5 | — | — | |
| AUNetParadigm=box-based, Backbone=ResNeXt152-FPN2020.12 | 46.5 | — | — | 55.8 | — | — | 32.5 | — | — | |
| AUNetStage=Two Stage, Backbone=ResNeXt-101-FPN, Flip=true, MS=false2020.03 | 46.5 | — | — | 55.8 | — | — | 32.5 | — | — | |
| PKU_360backbone=ResNeXt-152-FPN2019.01 | 46.3 | 79.6 | 56.1 | 58.6 | 83.7 | 69.6 | 27.6 | 73.6 | 35.6 | |
| DETRBackbone=ResNet-101, MS=false2020.11 | 46 | — | — | — | — | — | — | — | — | |
| DETRBackbone=RN-101, TTA=false2020.12 | 46 | — | — | — | — | — | — | — | — | |
| Panoptic FCNParadigm=box-free, Backbone=Res101-FPN2020.12 | 45.5 | — | — | 51.4 | — | — | 36.4 | — | — | |
| CIAEParadigm=box-based, Backbone=DCN101-FPN2020.12 | 44.5 | — | — | 49.7 | — | — | 36.8 | — | — | |
| Axial-DeepLab-LBackbone=Axial-ResNet-L, Multi-scale=true2020.03 | 44.2 | — | — | 49.2 | — | — | 36.8 | — | — | |
| Axial-DeepLab-LTTA=true2020.06 | 44.2 | — | — | 49.2 | — | — | 36.8 | — | — | |
| Axial-DeepLab-LBackbone=Axial-ResNet-L, MS=true2020.11 | 44.2 | — | — | 49.2 | — | — | 36.8 | — | — | |
| Axial-DeepLab-LBackbone=AX-L, TTA=true2020.12 | 44.2 | — | — | 49.2 | — | — | 36.8 | — | — | |
| Axial-DeepLab-LBackbone=Axial-ResNet-L, Multi-scale=false2020.03 | 43.6 | — | — | 48.9 | — | — | 35.6 | — | — | |
| Axial-DeepLabParadigm=box-free, Backbone=Axial-ResNet-L2020.12 | 43.6 | — | — | 48.9 | — | — | 35.6 | — | — | |
| Axial-DeepLab-LBackbone=AX-L, TTA=false2020.12 | 43.6 | — | — | 48.9 | — | — | 35.6 | — | — | |
| Axial-DeepLab-MBackbone=Axial-ResNet-M, Multi-scale=false2020.03 | 43.2 | — | — | 48.1 | — | — | 35.9 | — | — | |
| Panoptic FPNBackbone=LVT, Params (M)=5.4, FLOPs (G)=56.4, FPS (1333, 800)=20.42021.12 | 43 | — | — | 49.9 | — | — | 32.6 | — | — | |
| AdaptISBackbone=ResNeXt-1012019.09 | 42.8 | — | — | 50.1 | — | — | 31.8 | — | — | |
| AdaptISBackbone=ResNeXt-101, Flip=false, MS=false2019.11 | 42.8 | — | — | 53.2 | — | — | 36.7 | — | — | |
| AdaptISBackbone=ResNeXt-101, Multi-scale testing=false, Deformable convolution=false2019.06 | 42.8 | — | — | 50.1 | — | — | 31.8 | — | — | |
| AdaptISBackbone=ResNeXt-101, Multi-scale=true2020.03 | 42.8 | — | — | 53.2 | — | — | 36.7 | — | — | |
| AdaptISTTA=true2020.06 | 42.8 | — | — | 53.2 | — | — | 36.7 | — | — | |
| AdaptISBackbone=ResNeXt-101, MS=true2020.11 | 42.8 | — | — | 53.2 | — | — | 36.7 | — | — | |
| AdaptISParadigm=box-free, Backbone=ResNeXt-1012020.12 | 42.8 | — | — | 53.2 | — | — | 36.7 | — | — | |
| AdaptISStage=Two Stage, Backbone=ResNeXt-101, Flip=false, MS=false2020.03 | 42.8 | — | — | 50.1 | — | — | 31.8 | — | — | |
| Axial-DeepLab-SBackbone=Axial-ResNet-S, Multi-scale=false2020.03 | 42.2 | — | — | 46.5 | — | — | 35.7 | — | — | |
| Panoptic-DeepLabBackbone=Xception-71, Flip=true, MS=true2019.11 | 41.4 | — | — | 45.1 | — | — | 35.9 | — | — | |
| Panoptic-DeepLabBackbone=Xception-71, Multi-scale=true2020.03 | 41.4 | — | — | 45.1 | — | — | 35.9 | — | — | |
| Panoptic-DeepLabTTA=true2020.06 | 41.4 | — | — | 45.1 | — | — | 35.9 | — | — | |
| Panoptic-DeepLabBackbone=Xception-71, MS=false2020.11 | 41.4 | — | — | 45.1 | — | — | 35.9 | — | — | |
| Panoptic DeepLabBackbone=X-71, TTA=true2020.12 | 41.4 | — | — | 45.1 | — | — | 35.9 | — | — | |
| OANetBackbone=ResNet-101, Multi-scale testing=false, Deformable convolution=false2019.06 | 41.3 | — | — | 50.4 | — | — | 27.7 | — | — | |
| OANetbackbone=ResNet-101-FPN2020.12 | 41.3 | — | — | 50.4 | — | — | 27.7 | — | — | |
| Panoptic FPNBackbone=PVTv2-B0, Params (M)=5.3, FLOPs (G)=49.7, FPS (1333, 800)=23.52021.12 | 41.2 | — | — | 47.7 | — | — | 31.5 | — | — | |
| Panoptic FPNbackbone=ResNet-101, model_type=single network2019.01 | 40.9 | — | — | 48.3 | — | — | 29.7 | — | — | |
| Panoptic-FPNBackbone=ResNet-101, Flip=false, MS=false2019.11 | 40.9 | — | — | 48.3 | — | — | 29.7 | — | — | |
| Panoptic FPNBackbone=ResNet-101, Multi-scale testing=false, Deformable convolution=false2019.06 | 40.9 | — | — | 48.3 | — | — | 29.7 | — | — | |
| Panoptic-FPNBackbone=ResNet-101, Multi-scale=false2020.03 | 40.9 | — | — | 48.3 | — | — | 29.7 | — | — |