List your company

Panoptic Segmentation on Mapillary Vistas (val)

44.8PQPanoptic-DeepLab w/ SWideRNet-(1, 1, 4.5)
10.37619.31328.2537.187Sep 6, 2018Jun 13, 2019Mar 20, 2020Dec 26, 2020Oct 2, 2021Jul 10, 2022Apr 17, 2023

Evaluation results

MethodLinks
Panoptic-DeepLab w/ SWideRNet-(1, 1, 4.5)MS=true2020.1144.8——39.3——51.9————6022.2——————————————————————
Panoptic-DeepLab w/ SWideRNet-(1, 1, 4.5)MS=false2020.1143.7——38——51.2————59.421——————————————————————
Panoptic-DeepLab (ensemble of 6 models)MS=true2020.1142.2——————————58.718.2——————————————————————
Mask2Former + IBSBase Architecture=Mask2Former, IBS=true2023.0442.2——34.9——52———————75.784.1———————————————————
Mask2FormerBase Architecture=Mask2Former, IBS=false2023.0441.5——33.3——52.4———————71.778.8———————————————————
Axial-DeepLab-LMulti-scale=true, Params=44.9M, M-Adds=39.35T2020.0341.1——33.4——51.3————————————————————————————
Axial-DeepLab-LMS=true2020.1141.1——33.4——51.3————58.417.2——————————————————————
EfficientPSMode=Multi-Scale2020.0440.574.949.53573.844.447.776.256.4———20.854.1—————————————————————
Panoptic-DeepLabFlip=true, MS=true2019.1140.3——33.5——49.3————————————————————————————
Panoptic-DeepLab (Xception-71)Multi-scale=true, Params=46.7M, M-Adds=31.35T2020.0340.3——33.5——49.3————————————————————————————
Panoptic-DeepLab (Auto-XL++)Multi-scale=true, Params=72.2M, M-Adds=60.55T2020.0340.3——————————————————————————————————
Panoptic-DeepLab (Auto-XL++)MS=true2020.1140.3——————————57.616.9——————————————————————
Panoptic-DeepLabMode=Multi-Scale2020.0440.3——33.5——49.3—————17.256.8—————————————————————
Axial-DeepLab-LMulti-scale=false, Params=44.9M, M-Adds=1.55T2020.0340.1——32.7——49.8————————————————————————————
Axial-DeepLab-LMS=false2020.1140.1——32.7——49.8————57.616.7——————————————————————
Panoptic-DeepLab (HRNet-W48)Multi-scale=false, Params=71.7M, M-Adds=58.47T2020.0339.3——————————————————————————————————
EfficientPSMode=Single-Scale2020.0438.374.24833.973.34344.275.454.7———18.752.6—————————————————————
Panoptic-DeepLabFlip=true, MS=false2019.1138——30.6——47.9————————————————————————————
Ours CombinedBackbone=ResNet-50, Pre-training Data=ImageNet2019.0537.7——33.8——42.9——3916.450.4———————————————————————
SeamlessFlip=true, MS=true2019.1137.7——33.8——42.9————————————————————————————
Panoptic-DeepLabFlip=false, MS=false2019.1137.7——30.4——47.4————————————————————————————
Panoptic-DeepLabBackbone=Xception-71, Input Size=2177 x 2177, Speed (ms)=398, M-Adds (B)=1264.322019.1137.7——————————————————————————————————
SeamlessMulti-scale=false2020.0337.7——33.8——42.9————————————————————————————
Panoptic-DeepLab (Xception-71)Multi-scale=false, Params=46.7M, M-Adds=1.24T2020.0337.7——30.4——47.4————————————————————————————
SeamlessMS=false2020.1137.7——33.8——42.9————50.416.4——————————————————————
SeamlessBackbone=ResNet50, Pretrain=ImageNet, Single-scale=true, Type=Proposal-based2021.0637.7——33.8——42.9————————————————————————————
SeamlessMode=Single-Scale2020.0437.7——33.8——42.9—————16.450.4—————————————————————
Panoptic-DeepLabMode=Single-Scale2020.0437.7——30.4——47.4—————14.955.3—————————————————————
Ours IndependentBackbone=ResNet-50, Pre-training Data=ImageNet2019.0537.2——33.2——42.5——38.616.350.2———————————————————————
Panoptic FCNBackbone=Res50-FPN, Approach=box-free, Enhanced=true2020.1236.9——32.9——42.3————————————————————————————
PanopticFCNBackbone=R50-FPN2023.0336.9——32.9——42.3————————————————————————————
LPSNetBackbone=R50-FPN2023.0336.5——33.2——41————————————————————————————
Mask2FormerBackbone=R50, Scale=2048, 2048, FPS=3.2, GPU=A1002023.0336.3——————————————————————————————————
Panoptic FCN + IBSBase Architecture=Panoptic FCN, IBS=true2023.0436.3——33.6——40———————7782.2———————————————————
SeamlessBackbone=Res50-FPN, Approach=box-based2020.1236.2——33.6——40————————————————————————————
SeamlessBackbone=R502023.0336.2——33.6——40————————————————————————————
AdaptISBackbone=ResNeXt-1012019.0935.9——31.5——41.9————————————————————————————
AdaptISFlip=true, MS=true2019.1135.9——31.5——41.9————————————————————————————
AdaptISMulti-scale=false2020.0335.9——31.5——41.9————————————————————————————
AdaptISMS=false2020.1135.9——31.5——41.9————————————————————————————
AdaptISMode=Single-Scale2020.0435.9——31.5——41.9————————————————————————————
Panoptic FCNBase Architecture=Panoptic FCN, IBS=false2023.0435.5——31.8——40.3———————74.777.9———————————————————
Panoptic FCNBackbone=Res50-FPN, Approach=box-free, Enhanced=false2020.1234.8——30.6——40.5————————————————————————————
HLEBackbone=ResNet50, Pretrain=ImageNet, Single-scale=true, Type=Proposal-free2021.0634.6——27.8——43.5————————————————————————————
TASCNetFlip=true, MS=false2019.1134.3——34.8——33.6————————————————————————————
TASCNetMulti-scale=true2020.0334.3——34.8——33.6————————————————————————————
TASCNetMS=true2020.1134.3——34.8——33.6—————20.4——————————————————————
TASCNetMode=Multi-Scale2020.0434.3——34.8——33.6—————20.4——————————————————————
YOSOBackbone=R50, Scale=2048, 2048, FPS=7.1, GPU=A1002023.0334.1——24.3——47.2————————————————————————————
AdaptISBackbone=ResNet-1012019.0933.4——28.3——40.2————————————————————————————
Panoptic-DeepLabBackbone=ResNet-50, Input Size=2177 x 2177, Speed (ms)=286, M-Adds (B)=910.472019.1133.3——————————————————————————————————
Panoptic-DeepLabBackbone=Res50, Approach=box-free2020.1233.3——————————————————————————————————
Panoptic DeepLabBackbone=ResNet50, Pretrain=ImageNet, Single-scale=true, Type=Proposal-free2021.0633.3——————————————————————————————————
PanopticDeepLabBackbone=R50, Scale=2176, 2176, FPS=3.5, GPU=V1002023.0333.3——————————————————————————————————
TASCNetBackbone=ResNet-50, Pre-training Data=ImageNet + COCO2019.0532.6——31.1——34.4———18.5————————————————————————
TASCNetFlip=false, MS=false2019.1132.6——31.1——34.4————————————————————————————
TASCNetMulti-scale=false2020.0332.6——31.1——34.4————————————————————————————
TASCNetMS=false2020.1132.6——31.1——34.4—————18.5——————————————————————
TASCNetBackbone=Res50-FPN, Approach=box-based2020.1232.6——31.1——34.4————————————————————————————
TASCNetMode=Single-Scale2020.0432.6——31.1——34.4—————18.5——————————————————————
DeeperLabBackbone=Xception-71, Pre-training Data=ImageNet2019.0532——————————55.3———————————————————————
AdaptISBackbone=ResNet-502019.0932——26.6——39.1————————————————————————————
DeeperLabFlip=false, MS=false2019.1132——————————————————————————————————
DeeperLabBackbone=Xception-71, Input Size=1441 x 1441, Speed (ms)=4692019.1132——————————————————————————————————
DeeperLabMulti-scale=false2020.0332——————————————————————————————————
DeeperLabMS=false2020.1132——————————55.3———————————————————————
DeeperLabBackbone=Xception-71, Approach=box-free2020.1232——————————————————————————————————
AdaptISBackbone=Res50, Approach=box-free2020.1232——26.6——39.1————————————————————————————
DeeperLabBackbone=Xception71, Pretrain=ImageNet, Single-scale=true, Type=Proposal-free2021.0632——————————————————————————————————
DeeperLabMode=Single-Scale2020.0432————————————55.3—————————————————————
AdaptISBackbone=R502023.0332——39.1——26.6————————————————————————————
DeeperLabBackbone=Xception-712019.0931.9——————————————————————————————————
BGRNetBackbone=Res50-FPN, Approach=box-based2020.1231.8——34.1——27.3————————————————————————————
TASCNetBackbone=ResNet-502019.0930.7——28.6——33.4————————————————————————————
Panoptic-DeepLabBackbone=MNV3, Input Size=2177 x 2177, Speed (ms)=148, M-Adds (B)=138.122019.1128.8——————————————————————————————————
DeeperLabBackbone=W-MNV2, Input Size=1441 x 1441, Speed (ms)=3072019.1125.2——————————————————————————————————
JSIS-Net2018.0917.655.923.51047.614.127.566.935.8——————————————————————————
de Geus et al.Backbone=ResNet-50, Pre-training Data=ImageNet2019.0517.6——10——27.5————34.7———————————————————————
[6]Backbone=ResNet-502019.0917.6——10——27.5————————————————————————————
JSIS-NetMode=Single-Scale2020.0417.655.923.51047.614.127.566.935.8——————————————————————————
ODISEFeatures=Diffusion2023.0314.26117.2————————————————————————————————
CLIP(H)Features=CLIP(H)2023.0311.760.515.1————————————————————————————————
AdvEnt2023.04————————————————76.220.542.66.89.44.612.724.159.983.134.122.954.11613.518.672.740.331.2
CRST2023.04————————————————7722.640.27.810.55.511.321.856.577.629.418.45627.711.918.472.439.930.8
CVRN2023.04————————————————77.32147.810.513.47.514.125.162.186.437.720.45521.714.321.473.842.833.5
EDAPSBackbone=MiT-B52023.04————————————————58.843.457.125.629.134.335.541.277.859.13523.856.73624.325.575.953.441.2
FDA2023.04————————————————74.323.442.39.611.26.415.423.560.478.533.919.952.98.417.51672.340.330.9