Video Object Segmentation on DAVIS 2017 (val)
88.5J meanFAROS
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| FAROSEvaluation Protocol=standard semi-supervised VOS (first-frame annotation only)2026.06 | 88.5 | — | — | 92.6 | — | — | 90.5 | — | — | — | — | — | — | — | — | |
| SAM2Evaluation Protocol=standard semi-supervised VOS (first-frame annotation only), backbone=Hiera-B+2026.06 | 88.4 | — | — | 92.4 | — | — | 90.2 | — | — | — | — | — | — | — | — | |
| SAM 2Type=Segmentation Foundation Models, Backbone=Hiera-L2026.03 | 87.5 | — | — | 94 | — | — | 90.7 | — | — | — | — | — | — | — | — | |
| SAM 2Type=Segmentation Foundation Models, Backbone=Hiera-B+2026.03 | 87 | — | — | 93.4 | — | — | 90.2 | — | — | — | — | — | — | — | — | |
| SAM 2++2025.10 | 86.3 | — | — | 91.9 | — | — | 89.1 | — | — | — | — | — | — | — | — | |
| ReVOS2024.12 | 86 | — | — | — | — | — | — | — | — | — | — | — | — | 84.8 | 64.2 | |
| Cutie-basewith STM=true, Backbone=ResNet-50, Training Data=YouTube VOS + DAVIS + MOSE2024.11 | 85.6 | — | — | 91.9 | — | — | 88.8 | — | — | — | — | — | — | — | — | |
| Cutie-base2024.12 | 85.6 | — | — | — | — | — | — | — | — | — | — | — | — | 84.6 | 63.9 | |
| SAM22024.12 | 85.5 | — | — | — | — | — | — | — | — | — | — | — | — | 82.8 | 64.1 | |
| Cutie-basewith STM=true, Backbone=ResNet-50, Training Data=YouTube VOS + DAVIS2024.11 | 85.4 | — | — | 92.3 | — | — | 88.8 | — | — | — | — | — | — | — | — | |
| CutieMemory bank=true2023.03 | 85.4 | — | — | 92.3 | — | — | 88.8 | — | — | — | — | — | — | — | — | |
| JIMDBackbone=ResNet50, FPS=13.22024.09 | 85.2 | — | — | 91 | — | — | 88.1 | — | — | — | — | — | — | — | — | |
| SimVOS-BType=Dedicated VOS Systems, Backbone=ViT-B/162026.03 | 85 | — | — | 91 | — | — | 88 | — | — | — | — | — | — | — | — | |
| Cutie-baseType=Dedicated VOS Systems, Backbone=ResNet502026.03 | 84.6 | — | — | 91.1 | — | — | 87.9 | — | — | — | — | — | — | — | — | |
| ISVOSMemory bank=true2023.03 | 84.5 | — | — | 91.9 | — | — | 88.2 | — | — | — | — | — | — | — | — | |
| ISVOSEvaluation Protocol=standard semi-supervised VOS (first-frame annotation only)2026.06 | 84.5 | — | — | 91.9 | — | — | 88.2 | — | — | — | — | — | — | — | — | |
| ISVOSw/ BL30K=true2022.12 | 84.5 | — | — | 91.9 | — | — | 88.2 | — | — | — | — | — | — | — | — | |
| Cutie-smallwith STM=true, Backbone=ResNet-18, Training Data=YouTube VOS + DAVIS2024.11 | 84.3 | — | — | 90.1 | — | — | 87.2 | — | — | — | — | — | — | — | — | |
| DEVAtraining_data=with OVIS, FPS=25.32023.09 | 84.2 | — | — | 91 | — | — | 87.6 | — | — | — | — | — | — | — | — | |
| Upper-boundinput=original videos, evaluation_model=XMEM2025.12 | 84.06 | — | — | 91.33 | 97.02 | — | 87.7 | — | — | — | — | — | — | — | — | |
| XMemconstant_cost_inference=false, training_data=YouTube-VOS + BL30K, FPS=22.62023.03 | 84 | — | — | 91.4 | — | — | 87.7 | — | — | — | — | — | — | — | — | |
| XMemMemory Mechanism=Memory2023.03 | 84 | — | — | 91.4 | — | — | 87.7 | — | — | — | — | — | — | — | — | |
| XMemTraining Data=with video data, Venue=ECCV'222023.05 | 84 | — | — | 91.4 | — | — | 87.7 | — | — | — | — | — | — | — | — | |
| XMemVideo Data=true2024.03 | 84 | — | — | 91.4 | — | — | 87.7 | — | — | — | — | — | — | — | — | |
| XMemMemory bank=true2023.03 | 84 | — | — | 91.4 | — | — | 87.7 | — | — | — | — | — | — | — | — | |
| XMemw/ BL30K=true2022.12 | 84 | — | — | 91.4 | — | — | 87.7 | — | — | — | — | — | — | — | — | |
| ISVOSBL30K pre-training=false2024.09 | 83.7 | — | — | 90.5 | — | — | 87.1 | — | — | — | — | — | — | — | — | |
| ISVOSw/ BL30K=false2022.12 | 83.7 | — | — | 90.5 | — | — | 87.1 | — | — | — | — | — | — | — | — | |
| DEVAtraining_data=without OVIS, FPS=25.32023.09 | 83.6 | — | — | 90 | — | — | 86.8 | — | — | — | — | — | — | — | — | |
| DEVAwith STM=true, Backbone=ResNet-502024.11 | 83.6 | — | — | 90 | — | — | 86.8 | — | — | — | — | — | — | — | — | |
| DEVAMemory bank=true2023.03 | 83.6 | — | — | 90 | — | — | 86.8 | — | — | — | — | — | — | — | — | |
| Cutie-smallwith STM=true, Backbone=ResNet-18, Training Data=YouTube VOS + DAVIS + MOSE2024.11 | 83.5 | — | — | 89.5 | — | — | 86.5 | — | — | — | — | — | — | — | — | |
| BATMANIncludes YouTube-VOS in training=true, Resolution=480p2022.08 | 83.2 | — | — | 89.3 | — | — | 86.2 | — | — | — | — | — | — | — | — | |
| BATMANconstant_cost_inference=false2023.03 | 83.2 | — | — | 89.4 | — | — | 86.2 | — | — | — | — | — | — | — | — | |
| GSFMconstant_cost_inference=false, FPS=≈ 8.92023.03 | 83.1 | — | — | 89.3 | — | — | 86.2 | — | — | — | — | — | — | — | — | |
| GSFM2022.03 | 83.1 | — | — | 89.3 | — | — | 86.2 | — | — | — | — | — | 8.9 | — | — | |
| SwinB-AOST†Backbone=Swin-B, variant=†2022.03 | 83.1 | — | — | 89.4 | — | — | 86.3 | — | — | — | — | — | 12 | — | — | |
| PCVOSvariant=L52022.08 | 83 | — | — | 89.2 | — | — | 86.1 | — | — | — | — | — | — | — | — | |
| RAVOSRS=true, FPS=422022.07 | 82.9 | — | — | 89.3 | — | — | 86.1 | — | — | — | — | — | — | — | — | |
| XMemconstant_cost_inference=false, training_data=YouTube-VOS, FPS=22.62023.03 | 82.9 | — | — | 89.5 | — | — | 86.2 | — | — | — | — | — | — | — | — | |
| XMemLabeled data=100%2023.03 | 82.9 | — | — | 89.5 | — | — | 86.2 | — | — | — | — | — | — | — | — | |
| XMem2023.01 | 82.9 | — | — | 89.5 | — | — | 86.2 | — | — | — | — | — | — | — | — | |
| XMemInitialization format=Mask2023.08 | 82.9 | — | — | 89.5 | — | — | 86.2 | — | — | — | — | — | — | — | — | |
| XMemFPS=22.62023.09 | 82.9 | — | — | 89.5 | — | — | 86.2 | — | — | — | — | — | — | — | — | |
| XMemMethod Category=Memory-based2023.12 | 82.9 | — | — | 89.5 | — | — | 86.2 | — | — | — | — | — | — | — | — | |
| XMemBL30K pre-training=false, FPS=22.62024.09 | 82.9 | — | — | 89.5 | — | — | 86.2 | — | — | — | — | — | — | — | — | |
| XMemwith STM=true, Backbone=ResNet-502024.11 | 82.9 | — | — | 89.5 | — | — | 86.2 | — | — | — | — | — | — | — | — | |
| XMem2024.12 | 82.9 | — | — | — | — | — | — | — | — | — | — | — | — | 81.3 | 61.3 | |
| XMemEvaluation Protocol=standard semi-supervised VOS (first-frame annotation only)2026.06 | 82.9 | — | — | 89.5 | — | — | 86.2 | — | — | — | — | — | — | — | — | |
| XMemw/ BL30K=false2022.12 | 82.9 | — | — | 89.5 | — | — | 86.2 | — | — | — | — | — | — | — | — | |
| XMem*Labeled data=100%2023.03 | 82.8 | — | — | 89.7 | — | — | 86.2 | — | — | — | — | — | — | — | — | |
| DeAOTBackbone=SwinB-DeAOT-L2024.12 | 82.7 | — | — | — | — | — | — | — | — | — | — | — | — | 79.8 | 60.9 | |
| R50-AOSTBackbone=ResNet-50, n_l=32022.03 | 82.6 | — | — | 88.5 | — | — | 85.6 | — | — | — | — | — | 17.5 | — | — | |
| AOST-LBackbone=ResNet50, FPS=17.52024.09 | 82.6 | — | — | 88.5 | — | — | 85.6 | — | — | — | — | — | — | — | — | |
| RPCMResolution=Full-resolution, External Training Datasets=false2021.12 | 82.5 | — | — | 87.2 | — | — | 84.8 | — | — | — | — | — | — | — | — | |
| QDMNsynthetic training dataset=true2022.07 | 82.5 | — | — | 88.6 | — | — | 85.6 | — | — | — | — | — | — | — | — | |
| STCNRS=false, FPS=20*2022.07 | 82.5 | — | — | 88.7 | — | — | 85.6 | — | — | — | — | — | — | — | — | |
| SwinB-AOT-LPre-training=YouTube-VOS, Backbone=Swin-Base, FPS=12.12021.06 | 82.4 | — | — | 88.4 | — | — | 85.4 | — | — | — | — | — | — | — | — | |
| SwinB-AOT-LTraining data=YouTube-VOS2021.06 | 82.4 | — | — | 88.4 | — | — | 85.4 | — | — | — | — | — | 12.1 | — | — | |
| AOTTraining Data=with video data, Venue=NeurIPS'212023.05 | 82.4 | — | — | 88.4 | — | — | 85.4 | — | — | — | — | — | — | — | — | |
| SwinB-AOSTBackbone=Swin-B, n_l=32022.03 | 82.4 | — | — | 88.6 | — | — | 85.5 | — | — | — | — | — | 12 | — | — | |
| SwinB-AOT-LType=Dedicated VOS Systems, Backbone=Swin-B2026.03 | 82.4 | — | — | 88.4 | — | — | 85.4 | — | — | — | — | — | — | — | — | |
| R50-AOT-LPre-training=YouTube-VOS, Backbone=ResNet-50, FPS=18.02021.06 | 82.3 | — | — | 87.5 | — | — | 84.9 | — | — | — | — | — | — | — | — | |
| R50-AOT-LTraining data=YouTube-VOS2021.06 | 82.3 | — | — | 87.5 | — | — | 84.9 | — | — | — | — | — | 18 | — | — | |
| R50-AOTRS=false, FPS=24*2022.07 | 82.3 | — | — | 87.5 | — | — | 84.9 | — | — | — | — | — | — | — | — | |
| AOTIncludes YouTube-VOS in training=true, Resolution=480p2022.08 | 82.3 | — | — | 87.5 | — | — | 84.9 | — | — | — | — | — | — | — | — | |
| MobileVOSvariant=model soup, backbone=ResNet18, constant_cost_inference=true, training_data=YouTube-VOS + BL30K, FPS=90.62023.03 | 82.3 | — | — | 88.9 | — | — | 85.6 | — | — | — | — | — | — | — | — | |
| R50-AOT-LLabeled data=100%2023.03 | 82.3 | — | — | 87.5 | — | — | 84.9 | — | — | — | — | — | — | — | — | |
| STCN+InstMoveintegration=InstMove2023.03 | 82.3 | — | — | 87.9 | — | — | 85.1 | — | — | — | — | — | — | — | — | |
| AOT2023.01 | 82.3 | — | — | 87.5 | — | — | 84.9 | — | — | — | — | — | — | — | — | |
| AOTInitialization format=Mask2023.08 | 82.3 | — | — | 87.5 | — | — | 84.9 | — | — | — | — | — | — | — | — | |
| AOT-R50Backbone=ResNet-50, FPS=6.42023.09 | 82.3 | — | — | 87.5 | — | — | 84.9 | — | — | — | — | — | — | — | — | |
| R50-AOST†Backbone=ResNet-50, variant=†2022.03 | 82.3 | — | — | 88.2 | — | — | 85.3 | — | — | — | — | — | 17.5 | — | — | |
| AOT-LBackbone=ResNet50, FPS=182024.09 | 82.3 | — | — | 87.5 | — | — | 84.9 | — | — | — | — | — | — | — | — | |
| AOTwith STM=true, Backbone=ResNet-502024.11 | 82.3 | — | — | 87.5 | — | — | 84.9 | — | — | — | — | — | — | — | — | |
| RMem + DeAOTBackbone=R50-DeAOT-L, Memory bank=restricted, Temporal position embedding=false2024.12 | 82.3 | — | — | — | — | — | — | — | — | — | — | — | — | 79.3 | 60.9 | |
| AOTw/ BL30K=false2022.12 | 82.3 | — | — | 87.5 | — | — | 84.9 | — | — | — | — | — | — | — | — | |
| STCN2021.06 | 82.2 | — | — | 88.6 | — | — | 85.4 | — | — | — | — | — | 20.2 | — | — | |
| STCNReference frames=Multiple, Resolution=480p, Training Data=DAVIS and YouTube-VOS2022.07 | 82.2 | — | — | 88.6 | — | — | 85.4 | — | — | — | — | — | — | — | — | |
| STCN2022.07 | 82.2 | — | — | 88.6 | — | — | 85.4 | — | — | — | — | — | — | — | — | |
| STCN2022.08 | 82.2 | — | — | 88.6 | — | — | 85.4 | — | — | — | — | — | — | — | — | |
| STCNPublication=NeurIPS 2021, Pre-training on image datasets=true, FPS=26*, Training with YouTube-VOS=true2022.08 | 82.2 | — | — | 88.6 | — | — | 85.4 | — | — | — | — | — | — | — | — | |
| STCNInit=mask, Online Learning=false, Memory Bank=true2022.07 | 82.2 | — | — | 88.6 | — | — | 85.4 | — | — | — | — | — | — | — | — | |
| STCNIncludes YouTube-VOS in training=true, Resolution=480p2022.08 | 82.2 | — | — | 88.6 | — | — | 85.4 | — | — | — | — | — | — | — | — | |
| STCNLabeled data=100%2023.03 | 82.2 | — | — | 88.6 | — | — | 85.4 | — | — | — | — | — | — | — | — | |
| STCN2023.01 | 82.2 | — | — | 88.6 | — | — | 85.4 | — | — | — | — | — | — | — | — | |
| STCNMemory Mechanism=Memory2023.03 | 82.2 | — | — | 88.6 | — | — | 85.4 | — | — | — | — | — | — | — | — | |
| STCNInitialization format=Mask2023.08 | 82.2 | — | — | 88.6 | — | — | 85.4 | — | — | — | — | — | — | — | — | |
| DeAOTInitialization format=Mask2023.08 | 82.2 | — | — | 88.2 | — | — | 85.2 | — | — | — | — | — | — | — | — | |
| STCNFPS=13.22023.09 | 82.2 | — | — | 88.6 | — | — | 85.4 | — | — | — | — | — | — | — | — | |
| STCNMethod Category=Memory-based2023.12 | 82.2 | — | — | 88.6 | — | — | 85.4 | — | — | — | — | — | — | — | — | |
| DeAOTMethod Category=Memory-based2023.12 | 82.2 | — | — | 88.2 | — | — | 85.2 | — | — | — | — | — | — | — | — | |
| STCN2022.03 | 82.2 | — | — | 88.6 | — | — | 85.4 | — | — | — | — | — | 24.7 | — | — | |
| DeAOT-LBackbone=ResNet50, FPS=19.82024.09 | 82.2 | — | — | 88.2 | — | — | 85.2 | — | — | — | — | — | — | — | — | |
| STCNwith STM=true, Backbone=ResNet-502024.11 | 82.2 | — | — | 88.6 | — | — | 85.4 | — | — | — | — | — | — | — | — | |
| DeAOTwith STM=true, Backbone=ResNet-502024.11 | 82.2 | — | — | 88.2 | — | — | 85.2 | — | — | — | — | — | — | — | — | |
| STCNMemory bank=true2023.03 | 82.2 | — | — | 88.6 | — | — | 85.4 | — | — | — | — | — | — | — | — | |
| STCNType=Dedicated VOS Systems, Backbone=ResNet502026.03 | 82.2 | — | — | 88.6 | — | — | 85.4 | — | — | — | — | — | — | — | — | |
| STCNEvaluation Protocol=standard semi-supervised VOS (first-frame annotation only)2026.06 | 82.2 | — | — | 88.6 | — | — | 85.4 | — | — | — | — | — | — | — | — | |
| STCNw/ BL30K=false2022.12 | 82.2 | — | — | 88.6 | — | — | 85.4 | — | — | — | — | — | — | — | — |