Semi-supervised Video Object Segmentation on DAVIS 2017 (val)
90.7J&F ScoreSAM 2
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SAM 2Backbone=Hiera-L, Extra Training Data (SA-1B, SA-V)=false2024.08 | 90.7 | 87.5 | 94 | |
| SAM 2Backbone=Hiera-B+, Extra Training Data (SA-1B, SA-V)=false2024.08 | 90.2 | 87 | 93.4 | |
| SAM 2Backbone=Hiera-L, Extra Training Data (SA-1B, SA-V)=true2024.08 | 90.2 | 86.9 | 93.4 | |
| Joint Former2024.08 | 90.1 | 87 | 93.2 | |
| SAM 2Backbone=Hiera-B+, Extra Training Data (SA-1B, SA-V)=true2024.08 | 90 | 86.8 | 93.1 | |
| SAM 2Backbone=Hiera-S, Extra Training Data (SA-1B, SA-V)=true2024.08 | 89.6 | 86.3 | 92.9 | |
| SAM 2Backbone=Hiera-T, Extra Training Data (SA-1B, SA-V)=true2024.08 | 89.4 | 85.8 | 92.9 | |
| SAM 2.1 (T)Parameters (M)=38.9, Training data ratio=1, Tokens ratio=1, FPS (V100)=8.82026.05 | 89.4 | — | — | |
| EfficientTAMParameters (M)=18.0, Training data ratio=0.92, Tokens ratio=0.25, FPS (V100)=20.12026.05 | 88.4 | — | — | |
| ISVOS2024.08 | 88.2 | 84.5 | 91.9 | |
| Cutie-base+2024.08 | 88.1 | 85.5 | 90.8 | |
| Cutie-base+Parameters (M)=35.0, Training data ratio=0.02, Tokens ratio=1, FPS (V100)=17.92026.05 | 88.1 | — | — | |
| SimVOS-B2024.08 | 88 | 85 | 91 | |
| Cutie-base2024.08 | 87.9 | 84.6 | 91.1 | |
| Cutie-baseParameters (M)=35.0, Training data ratio=0.02, Tokens ratio=12026.05 | 87.9 | — | — | |
| EdgeTAMParameters (M)=13.9, Training data ratio=0.92, Tokens ratio=0.14, FPS (V100)=19.22026.05 | 87.7 | — | — | |
| DEVA2024.08 | 87 | 83.8 | 90.2 | |
| DEVAParameters (M)=69.0, Training data ratio=0.02, Tokens ratio=12026.05 | 87 | — | — | |
| XMemConstant Cost=false, FPS=22.62023.06 | 86.2 | 82.9 | 89.5 | |
| SwinB-DeAOT-L2024.08 | 86.2 | 83.1 | 89.2 | |
| STCN + TrickVOS (PT)Constant Cost=false, STCN re-training (no ASPP/BL30K)=true, FPS=35.12023.06 | 86.1 | 82.6 | 89.6 | |
| XMem2024.08 | 86 | 82.8 | 89.2 | |
| XMemParameters (M)=62.0, Training data ratio=0.02, Tokens ratio=12026.05 | 86 | — | — | |
| STCN + Trick 1+2Constant Cost=false, STCN re-training (no ASPP/BL30K)=true, FPS=48.32023.06 | 85.4 | 82.1 | 88.8 | |
| STCN2024.08 | 85.4 | 82.2 | 88.6 | |
| SwinB-AOT-L2024.08 | 85.4 | 82.4 | 88.4 | |
| STCNParameters (M)=54.0, Training data ratio=0.02, Tokens ratio=1, FPS (V100)=13.22026.05 | 85.4 | — | — | |
| STCNConstant Cost=false, Additional training data (BL30K)=true, FPS=20.22023.06 | 85.3 | 82 | 88.6 | |
| MiVOSConstant Cost=false, Additional training data (BL30K)=true, FPS=11.22023.06 | 84.5 | 81.7 | 87.4 | |
| RDE-VOSConstant Cost=true, FPS=27.02023.06 | 84.2 | 80.8 | 87.5 | |
| RDE2024.08 | 84.2 | 80.8 | 87.5 | |
| RDEParameters (M)=64.0, Training data ratio=0.02, Tokens ratio=12026.05 | 84.2 | — | — | |
| STCNConstant Cost=false, STCN re-training (no ASPP/BL30K)=true, FPS=48.32023.06 | 84 | 80.6 | 87.4 | |
| TinySAM 2Parameters (M)=17.5, Training data ratio=0.03, Tokens ratio=0.07, FPS (V100)=25.62026.05 | 83.1 | — | — | |
| Baseline + TrickVOS (PT)Constant Cost=true, FPS=76.42023.06 | 82.7 | 79.4 | 86 | |
| Baseline + TrickVOS (CV)Constant Cost=true, FPS=79.32023.06 | 82.6 | 79.3 | 85.9 | |
| CFBIConstant Cost=true2023.06 | 81.9 | 79.3 | 84.5 | |
| SAM-I2VParameters (M)=18.9, Training data ratio=0.02, Tokens ratio=1, FPS (V100)=6.62026.05 | 81.9 | — | — | |
| STMConstant Cost=false, FPS=10.22023.06 | 81.8 | 79.2 | 84.3 | |
| SwiftNetConstant Cost=true, FPS=<25.02023.06 | 81.1 | 78.3 | 83.9 | |
| BaselineConstant Cost=true, FPS=99.52023.06 | 80.9 | 77.5 | 84.2 | |
| GCNetConstant Cost=true, FPS=<25.02023.06 | 71.4 | 69.3 | 73.5 | |
| DINOv3Number of Parameters=7B, Patch Size=16, Image Resolution (shorter side)=480 px, Evaluation Protocol=training-free label propagation, Features=frozen2026.07 | 71.1 | — | — | |
| DINOv3 ViT-H+Number of Parameters=0.8B, Patch Size=16, Image Resolution (shorter side)=480 px, Evaluation Protocol=training-free label propagation, Features=frozen2026.07 | 71.1 | — | — | |
| LingBot-Vision ViT-gNumber of Parameters=1B, Patch Size=16, Image Resolution (shorter side)=480 px, Evaluation Protocol=training-free label propagation, Features=frozen2026.07 | 70 | — | — | |
| V-JEPA 2.1 ViT-GNumber of Parameters=2B, Patch Size=16, Image Resolution (shorter side)=480 px, Evaluation Protocol=training-free label propagation, Features=frozen2026.07 | 69 | — | — | |
| PEspatialNumber of Parameters=2B, Patch Size=14, Image Resolution (shorter side)=420 px, Evaluation Protocol=training-free label propagation, Features=frozen2026.07 | 68.4 | — | — | |
| V-JEPA 2.1 ViT-gNumber of Parameters=1B, Patch Size=16, Image Resolution (shorter side)=480 px, Evaluation Protocol=training-free label propagation, Features=frozen2026.07 | 68.1 | — | — | |
| AM-RADIOv2.5Number of Parameters=1B, Patch Size=14, Image Resolution (shorter side)=420 px, Evaluation Protocol=training-free label propagation, Features=frozen2026.07 | 66.5 | — | — | |
| DINOv2Number of Parameters=1B, Patch Size=14, Image Resolution (shorter side)=420 px, Evaluation Protocol=training-free label propagation, Features=frozen2026.07 | 63.9 | — | — | |
| Web-DINONumber of Parameters=7B, Patch Size=14, Image Resolution (shorter side)=420 px, Evaluation Protocol=training-free label propagation, Features=frozen2026.07 | 57.2 | — | — | |
| SigLIP 2Number of Parameters=1B, Patch Size=16, Image Resolution (shorter side)=480 px, Evaluation Protocol=training-free label propagation, Features=frozen2026.07 | 56.1 | — | — | |
| V-JEPA2 ViT-gNumber of Parameters=1B, Patch Size=16, Image Resolution (shorter side)=480 px, Evaluation Protocol=training-free label propagation, Features=frozen2026.07 | 52.5 | — | — | |
| InternVideo2-1BNumber of Parameters=1B, Patch Size=14, Image Resolution (shorter side)=420 px, Evaluation Protocol=training-free label propagation, Features=frozen2026.07 | 50.6 | — | — | |
| PEcoreNumber of Parameters=2B, Patch Size=14, Image Resolution (shorter side)=420 px, Evaluation Protocol=training-free label propagation, Features=frozen2026.07 | 48.2 | — | — |