Video Object Segmentation on DAVIS 2017 (test)
82.9J (Jaccard Index)XMem
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| XMem2024.03 | 82.9 | — | 89.5 | — | 86.2 | |
| AOT2024.03 | 82.3 | — | 87.5 | — | 84.9 | |
| STCN2024.03 | 82.2 | — | 88.6 | — | 85.4 | |
| One Tracker2024.03 | 79.4 | — | 85.6 | — | 82.5 | |
| STM2024.03 | 79.2 | — | 84.3 | — | 81.8 | |
| CFBI2024.03 | 79.1 | — | 84.6 | — | 81.9 | |
| SwinB-AOSTBackbone=Swin-Base, Number of LSTT blocks=3, FPS=12.02022.03 | 78.8 | — | 86.6 | — | 82.7 | |
| TarVIS2024.03 | 78.7 | — | 87 | — | 82 | |
| SwinB-AOSTBackbone=Swin-Base, Number of LSTT blocks=3, FPS=12.0, extra=†2022.03 | 78.2 | — | 85.6 | — | 81.9 | |
| DINO1st-frame-GT=true, RGB=true, Flow=false2022.07 | 77.7 | — | 79.6 | — | 78.7 | |
| UNINEXT2024.03 | 77.7 | — | 85.8 | — | 81.8 | |
| SwinB-AOT-LPre-training=YouTube-VOS, Backbone=Swin-Base, FPS=12.12021.06 | 77.3 | 81.2 | 85.1 | — | — | |
| SwinB-AOT-LTraining data=YouTube-VOS2021.06 | 77.3 | 81.2 | 85.1 | 12.1 | — | |
| R50-AOST-LBackbone=ResNet-50, Number of LSTT blocks=3, FPS=17.5, extra=†2022.03 | 76.7 | — | 83.9 | — | 80.3 | |
| R50-AOSTBackbone=ResNet-50, Number of LSTT blocks=3, FPS=17.52022.03 | 76.2 | — | 83.6 | — | 79.9 | |
| R50-AOT-LPre-training=YouTube-VOS, Backbone=ResNet-50, FPS=18.02021.06 | 75.9 | 79.6 | 83.3 | — | — | |
| R50-AOT-LTraining data=YouTube-VOS2021.06 | 75.9 | 79.6 | 83.3 | 18 | — | |
| RPCMFPS=1.9+2022.03 | 75.8 | — | 82.6 | — | 79.2 | |
| AOSTNumber of LSTT blocks=3, FPS=18.22022.03 | 75.6 | — | 83.3 | — | 79.5 | |
| MiVOSConstant Cost during inference=false, Resolution=full, YouTube-VOS added during training=true, BL30K added during training=true2022.05 | 74.9 | — | 82.2 | — | 78.6 | |
| RDE-VOSConstant Cost during inference=true, Resolution=full, YouTube-VOS added during training=true, BL30K added during training=true2022.05 | 74.9 | — | 82.9 | — | 78.9 | |
| MiVOSConstant Cost=false, 600p Resolution=false, YouTube-VOS Training=true, BL30K Training=true2022.05 | 74.9 | — | 82.2 | — | 78.6 | |
| RDE-VOSConstant Cost=true, 600p Resolution=false, YouTube-VOS Training=true, BL30K Training=true2022.05 | 74.9 | — | 82.9 | — | 78.9 | |
| HMMNFPS=3.4+2022.03 | 74.7 | — | 82.5 | — | 78.6 | |
| CFBI+Fine-tuning=false, Simulated data=false, YouTube-VOS training=true, Resolution=600p, Inference time (t/s)=0.292020.10 | 74.4 | 78 | 81.6 | — | — | |
| CFBI+*Pre-training=YouTube-VOS, FPS=3.42021.06 | 74.4 | 78 | 81.6 | — | — | |
| CFBI+Training data=YouTube-VOS, Inference resolution=600p2021.06 | 74.4 | 78 | 81.6 | 3.4 | — | |
| CFBI+Resolution=600p, FPS=3.42022.03 | 74.4 | — | 81.6 | — | 78 | |
| AOT-LPre-training=YouTube-VOS, FPS=18.72021.06 | 74.3 | 78.3 | 82.3 | — | — | |
| AOT-LTraining data=YouTube-VOS2021.06 | 74.3 | 78.3 | 82.3 | 18.7 | — | |
| STCNConstant Cost during inference=false, Resolution=full, YouTube-VOS added during training=true, BL30K added during training=true2022.05 | 74.3 | — | 81.3 | — | 77.8 | |
| STCNConstant Cost=false, 600p Resolution=false, YouTube-VOS Training=true, BL30K Training=true2022.05 | 74.3 | — | 81.3 | — | 77.8 | |
| AOT-LFPS=18.72022.03 | 74.3 | — | 82.3 | — | 78.3 | |
| KMNVOSFine-tuning=false, Simulated data=true, YouTube-VOS training=true, Resolution=600p2020.10 | 74.1 | 77.2 | 80.3 | — | — | |
| KMN*Pre-training=YouTube-VOS2021.06 | 74.1 | 77.2 | 80.3 | — | — | |
| KMNTraining data=YouTube-VOS, Inference resolution=600p2021.06 | 74.1 | 77.2 | 80.3 | — | — | |
| KMNConstant Cost during inference=false, Resolution=600p, YouTube-VOS added during training=true2022.05 | 74.1 | — | 80.3 | — | 77.2 | |
| KMNConstant Cost=false, 600p Resolution=true, YouTube-VOS Training=true, BL30K Training=false2022.05 | 74.1 | — | 80.3 | — | 77.2 | |
| KMNResolution=600p, FPS=2.8+2022.03 | 74.1 | — | 80.3 | — | 77.2 | |
| GSFMFPS=8.92022.03 | 74 | — | 80.9 | — | 77.5 | |
| CFBIYouTube-VOS Training=true, Multi-scale evaluation=true, FS=false2020.03 | 73.8 | 77.5 | 81.1 | — | — | |
| RDE-VOSConstant Cost during inference=true, Resolution=full, YouTube-VOS added during training=true2022.05 | 73.6 | — | 81.2 | — | 77.4 | |
| RDE-VOSConstant Cost=true, 600p Resolution=false, YouTube-VOS Training=true, BL30K Training=false2022.05 | 73.6 | — | 81.2 | — | 77.4 | |
| CFBIFine-tuning=false, Simulated data=false, YouTube-VOS training=true, Resolution=600p, Inference time (t/s)=0.352020.10 | 73 | 76.6 | 80.1 | — | — | |
| CFBI*Pre-training=YouTube-VOS, FPS=2.92021.06 | 73 | 76.6 | 80.1 | — | — | |
| CFBITraining data=YouTube-VOS, Inference resolution=600p2021.06 | 73 | 76.6 | 80.1 | 2.9 | — | |
| CFBIResolution=600p, FPS=2.92022.03 | 73 | — | 80.1 | — | 76.6 | |
| CRW1st-frame-GT=true, RGB=true, Flow=false2022.07 | 72.9 | — | 74.1 | — | 73.4 | |
| STCNResolution=480p, FPS=19.52022.03 | 72.7 | — | 79.6 | — | 76.1 | |
| Ge et al.Constant Cost during inference=false, Resolution=full2022.05 | 72 | — | 78.3 | — | 75.2 | |
| Ge et al.Constant Cost during inference=true, Resolution=full2022.05 | 72 | — | 78.3 | — | 75.2 | |
| Ge et al.Constant Cost=false, 600p Resolution=false, YouTube-VOS Training=true, BL30K Training=false2022.05 | 72 | — | 78.3 | — | 75.2 | |
| Ge et al.Constant Cost=true, 600p Resolution=false, YouTube-VOS Training=true, BL30K Training=false2022.05 | 72 | — | 78.3 | — | 75.2 | |
| RMNetConstant Cost during inference=false, Resolution=full2022.05 | 71.9 | — | 78.1 | — | 75 | |
| RMNetConstant Cost=false, 600p Resolution=false, YouTube-VOS Training=true, BL30K Training=false2022.05 | 71.9 | — | 78.1 | — | 75 | |
| CFBI+Fine-tuning=false, Simulated data=false, YouTube-VOS training=true, Inference time (t/s)=0.192020.10 | 71.6 | 75.6 | 79.6 | — | — | |
| AOT-BPre-training=YouTube-VOS, FPS=29.62021.06 | 71.6 | 75.5 | 79.3 | — | — | |
| AOT-BTraining data=YouTube-VOS2021.06 | 71.6 | 75.5 | 79.3 | 29.6 | — | |
| CFBI++Constant Cost during inference=true, Resolution=full2022.05 | 71.6 | — | 79.6 | — | 75.6 | |
| CFBI++Constant Cost=true, 600p Resolution=false, YouTube-VOS Training=true, BL30K Training=false2022.05 | 71.6 | — | 79.6 | — | 75.6 | |
| AOT-BFPS=29.62022.03 | 71.6 | — | 79.3 | — | 75.5 | |
| CFBIFine-tuning=false, Simulated data=false, YouTube-VOS training=true, Inference time (t/s)=0.192020.10 | 71.4 | 75 | 78.7 | — | — | |
| CFBIPre-training=YouTube-VOS, FPS=5.32021.06 | 71.4 | 75 | 78.7 | — | — | |
| CFBITraining data=YouTube-VOS2021.06 | 71.4 | 75 | 78.7 | 5.3 | — | |
| CFBIResolution=480p, FPS=5.32022.03 | 71.4 | — | 78.7 | — | 75 | |
| CFBIYouTube-VOS Training=true, FS=false2020.03 | 71.1 | 74.8 | 78.5 | — | — | |
| CFBIConstant Cost during inference=true, Resolution=full, YouTube-VOS added during training=true2022.05 | 71.1 | — | 78.5 | — | 74.8 | |
| CFBIConstant Cost=true, 600p Resolution=false, YouTube-VOS Training=true, BL30K Training=false2022.05 | 71.1 | — | 78.5 | — | 74.8 | |
| MAST1st-frame-GT=true, RGB=true, Flow=false2022.07 | 71 | — | 70.8 | — | 70.9 | |
| AOT-SPre-training=YouTube-VOS, FPS=40.02021.06 | 70.3 | 73.9 | 77.5 | — | — | |
| AOT-STraining data=YouTube-VOS2021.06 | 70.3 | 73.9 | 77.5 | 40 | — | |
| AOT-SFPS=40.02022.03 | 70.3 | — | 77.5 | — | 73.9 | |
| STMVOSYouTube-VOS Training=true, FS=true2020.03 | 69.3 | 72.2 | 75.2 | — | — | |
| STMVOSFine-tuning=false, Simulated data=true, YouTube-VOS training=true, Resolution=600p2020.10 | 69.3 | 72.2 | 75.2 | — | — | |
| STM*Pre-training=YouTube-VOS2021.06 | 69.3 | 72.2 | 75.2 | — | — | |
| STMConstant Cost during inference=false, Resolution=600p, YouTube-VOS added during training=true2022.05 | 69.3 | — | 75.2 | — | 72.2 | |
| STMConstant Cost=false, 600p Resolution=true, YouTube-VOS Training=true, BL30K Training=false2022.05 | 69.3 | — | 75.2 | — | 72.2 | |
| STMResolution=600p, FPS=2.3+2022.03 | 69.3 | — | 75.2 | — | 72.2 | |
| AOT-TPre-training=YouTube-VOS, FPS=51.42021.06 | 68.3 | 72 | 75.7 | — | — | |
| AOT-TTraining data=YouTube-VOS2021.06 | 68.3 | 72 | 75.7 | 51.4 | — | |
| PREMVOSFS=true2020.03 | 67.5 | 71.6 | 75.7 | — | — | |
| PREMVOSFine-tuning=true, Simulated data=true, Inference time (t/s)=41.32020.10 | 67.5 | 71.6 | 75.7 | — | — | |
| PREMFPS=0.022021.06 | 67.5 | 71.6 | 75.7 | — | — | |
| OmniTracker2024.03 | 66.8 | — | 75.2 | — | 71 | |
| UVC1st-frame-GT=true, RGB=true, Flow=false2022.07 | 66.2 | — | 64.7 | — | 65.5 | |
| Siam R-CNN2024.03 | 66.1 | — | 75 | — | 70.6 | |
| OCLR (test. adap.)1st-frame-GT=false, RGB=true, Flow=true2022.07 | 65.2 | — | 63.6 | — | 64.4 | |
| Unicorn2024.03 | 65.2 | — | 73.2 | — | 69.2 | |
| UniTrack2024.03 | 58.4 | — | — | — | — | |
| FEELVOSYouTube-VOS Training=true, FS=false2020.03 | 55.2 | 57.8 | 60.5 | — | — | |
| FEELVOSFine-tuning=false, Simulated data=false, YouTube-VOS training=true, Inference time (t/s)=0.542020.10 | 55.2 | 57.8 | 60.5 | — | — | |
| FEELPre-training=YouTube-VOS, FPS=1.92021.06 | 55.2 | 57.8 | 60.5 | — | — | |
| OCLR (flow-only)1st-frame-GT=false, RGB=false, Flow=true2022.07 | 54.5 | — | 55.7 | — | 55.1 | |
| SiamMask2024.03 | 54.3 | — | 58.5 | — | 56.4 | |
| CorrFlow1st-frame-GT=true, RGB=true, Flow=false2022.07 | 54.2 | — | 53.7 | — | 54 | |
| OnAVOSFS=true2020.03 | 53.4 | 56.5 | 59.6 | — | — | |
| OnAVOSFine-tuning=true, Simulated data=false, Inference time (t/s)=392020.10 | 53.4 | 56.5 | 59.6 | — | — | |
| OnAFPS=0.032021.06 | 53.4 | 56.5 | 59.6 | — | — | |
| RGMPFS=true2020.03 | 51.3 | 52.9 | 54.4 | — | — | |
| RGMPFine-tuning=false, Simulated data=true, Inference time (t/s)=0.42+2020.10 | 51.3 | 52.9 | 54.4 | — | — |