Semi-supervised Video Object Segmentation on SA-V (test)
79.5J&F ScoreSAM 2
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SAM 2Backbone=Hiera-L, Training Data=SA-1B, SA-V, and internal2024.08 | 79.5 | 76 | 83 | |
| SAM 2Backbone=Hiera-L2024.08 | 78.4 | 74.9 | 82 | |
| SAM 2Backbone=Hiera-B+, Training Data=SA-1B, SA-V, and internal2024.08 | 78.2 | 74.8 | 81.7 | |
| SAM 2Backbone=Hiera-B+2024.08 | 77 | 73.5 | 80.5 | |
| SAM 2Backbone=Hiera-S, Training Data=SA-1B, SA-V, and internal2024.08 | 76.6 | 73 | 80.2 | |
| SAM 2Backbone=Hiera-T, Training Data=SA-1B, SA-V, and internal2024.08 | 76.5 | 72.9 | 80.1 | |
| SAM 2.1 (T)Parameters (M)=38.9, Training data ratio=1, Tokens ratio=1, FPS (V100)=8.82026.05 | 76.5 | — | — | |
| EdgeTAMParameters (M)=13.9, Training data ratio=0.92, Tokens ratio=0.14, FPS (V100)=19.22026.05 | 71.7 | — | — | |
| EfficientTAMParameters (M)=18.0, Training data ratio=0.92, Tokens ratio=0.25, FPS (V100)=20.12026.05 | 70.8 | — | — | |
| TinySAM 2Parameters (M)=17.5, Training data ratio=0.03, Tokens ratio=0.07, FPS (V100)=25.62026.05 | 65.3 | — | — | |
| Cutie-base+2024.08 | 62.8 | 59.8 | 65.8 | |
| Cutie-base+Parameters (M)=35.0, Training data ratio=0.02, Tokens ratio=1, FPS (V100)=17.92026.05 | 62.8 | — | — | |
| Cutie-base2024.08 | 62.7 | 59.7 | 65.7 | |
| Cutie-baseParameters (M)=35.0, Training data ratio=0.02, Tokens ratio=12026.05 | 62.7 | — | — | |
| STCN2024.08 | 62.5 | 59 | 66 | |
| STCNParameters (M)=54.0, Training data ratio=0.02, Tokens ratio=1, FPS (V100)=13.22026.05 | 62.5 | — | — | |
| XMem2024.08 | 62.3 | 58.9 | 65.8 | |
| XMemParameters (M)=62.0, Training data ratio=0.02, Tokens ratio=12026.05 | 62.3 | — | — | |
| SwinB-DeAOT-L2024.08 | 61.8 | 57.2 | 66.3 | |
| SAM-I2VParameters (M)=18.9, Training data ratio=0.02, Tokens ratio=1, FPS (V100)=6.62026.05 | 59.3 | — | — | |
| DEVA2024.08 | 56.2 | 52.4 | 60.1 | |
| DEVAParameters (M)=69.0, Training data ratio=0.02, Tokens ratio=12026.05 | 56.2 | — | — | |
| RDE2024.08 | 53.9 | 50.5 | 57.3 | |
| RDEParameters (M)=64.0, Training data ratio=0.02, Tokens ratio=12026.05 | 53.9 | — | — | |
| SwinB-AOT-L2024.08 | 50.3 | 46 | 54.6 | |
| SimVOS-B2024.08 | 44.1 | 40.5 | 47.7 |