Video Object Segmentation on SA-V (test)
82.8J&FSENTRY-HiM-L
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SENTRY-HiM-LEvaluation Protocol=first-frame-mask2026.06 | 82.8 | — | — | — | |
| SENTRY-SA-LEvaluation Protocol=first-frame-mask2026.06 | 82.5 | — | — | — | |
| SENTRY-D4S-LEvaluation Protocol=first-frame-mask2026.06 | 82.2 | — | — | — | |
| SeC2025.07 | 81.7 | — | — | — | |
| HiM2SAM-LEvaluation Protocol=first-frame-mask2026.06 | 81.5 | — | — | — | |
| SAMITE-LEvaluation Protocol=first-frame-mask2026.06 | 81.3 | — | — | — | |
| SAM2.1Long2024.10 | 81.2 | 77.6 | 84.9 | — | |
| SAM2LongSize=Large, Base Version=2.12024.10 | 81.2 | 77.6 | 84.9 | — | |
| SAM2.1LongMode=Long-term2025.07 | 81.2 | — | — | — | |
| SAM2Long-LEvaluation Protocol=first-frame-mask2026.06 | 81.2 | — | — | — | |
| DAM4SAM-LEvaluation Protocol=first-frame-mask2026.06 | 81 | — | — | — | |
| SENTRY-SR-LEvaluation Protocol=first-frame-mask2026.06 | 81 | — | — | — | |
| OriginalMemory interval (delta_t)=52026.02 | 80.9 | — | — | — | |
| SAM2Long2024.10 | 80.8 | 76.8 | 84.7 | — | |
| SAM2LongSize=Base+, Base Version=2.12024.10 | 80.8 | 77.1 | 84.5 | — | |
| SAM2LongSize=Large, Base Version=2.02024.10 | 80.8 | 76.8 | 84.7 | — | |
| SAM2LongSize=Small, Base Version=2.12024.10 | 80.4 | 76.6 | 84.1 | — | |
| SMRIE (Image Encoder Optimization)=false, MA (Memory Attention Optimization)=true, Speedup=1.78x, Memory interval (delta_t)=52026.02 | 80.2 | — | — | — | |
| SAMURAI-LEvaluation Protocol=first-frame-mask2026.06 | 80.2 | — | — | — | |
| SENTRY-S2-LEvaluation Protocol=first-frame-mask2026.06 | 80.1 | — | — | — | |
| SAMURAI2025.07 | 80 | — | — | — | |
| OriginalMemory interval (delta_t)=12026.02 | 79.8 | — | — | — | |
| SWRIE (Image Encoder Optimization)=true, MA (Memory Attention Optimization)=false, Speedup=1.83x, Memory interval (delta_t)=52026.02 | 79.8 | — | — | — | |
| SMR-randomIE (Image Encoder Optimization)=false, MA (Memory Attention Optimization)=true, Speedup=1.75x, Memory interval (delta_t)=52026.02 | 79.7 | — | — | — | |
| SAM 2.1+2024.10 | 79.6 | 76.1 | 83.2 | — | |
| SAM 2.1Size=Large, Base Version=2.12024.10 | 79.6 | 76.1 | 83.2 | — | |
| SMRIE (Image Encoder Optimization)=false, MA (Memory Attention Optimization)=true, Speedup=1.78x, Memory interval (delta_t)=12026.02 | 79.6 | — | — | — | |
| SAM 2.12025.07 | 79.6 | — | — | — | |
| SAM2-LEvaluation Protocol=first-frame-mask2026.06 | 79.6 | — | — | — | |
| SMR-uniformIE (Image Encoder Optimization)=false, MA (Memory Attention Optimization)=true, Speedup=1.76x, Memory interval (delta_t)=52026.02 | 79.3 | — | — | — | |
| SAM2LongSize=Tiny, Base Version=2.12024.10 | 79 | 75.2 | 82.9 | — | |
| SWRIE (Image Encoder Optimization)=true, MA (Memory Attention Optimization)=false, Speedup=1.83x, Memory interval (delta_t)=12026.02 | 79 | — | — | — | |
| Efficient-SAM2IE (Image Encoder Optimization)=true, MA (Memory Attention Optimization)=true, Speedup=1.80x, Memory interval (delta_t)=52026.02 | 79 | — | — | — | |
| SMR-randomIE (Image Encoder Optimization)=false, MA (Memory Attention Optimization)=true, Speedup=1.75x, Memory interval (delta_t)=12026.02 | 78.9 | — | — | — | |
| SMR-uniformIE (Image Encoder Optimization)=false, MA (Memory Attention Optimization)=true, Speedup=1.76x, Memory interval (delta_t)=12026.02 | 78.9 | — | — | — | |
| Efficient-SAM2IE (Image Encoder Optimization)=true, MA (Memory Attention Optimization)=true, Speedup=1.80x, Memory interval (delta_t)=12026.02 | 78.8 | — | — | — | |
| SAM2-Base+ (Reference)Model=SAM2-Base+, Precision=FP2025.03 | 78.74 | — | — | — | |
| SAM2LongSize=Tiny, Base Version=2.02024.10 | 78.7 | 74.6 | 82.7 | — | |
| SAM2LongSize=Base+, Base Version=2.02024.10 | 78.5 | 74.7 | 82.2 | — | |
| SAM 2 (Hiera-L)Backbone=Hiera-L, Prompting protocol=first-frame ground-truth mask2024.08 | 78.4 | — | — | — | |
| SAM2LongSize=Small, Base Version=2.02024.10 | 78.1 | 74.1 | 82 | — | |
| SAM 2.1Size=Base+, Base Version=2.12024.10 | 77.7 | 74.2 | 81.2 | — | |
| G2TAM2026.07 | 77.6 | — | — | — | |
| SAM2-Small (Reference)Model=SAM2-Small, Precision=FP2025.03 | 77.43 | — | — | — | |
| SAM2-Tiny (Reference)Model=SAM2-Tiny, Precision=FP2025.03 | 77.13 | — | — | — | |
| SAM 2 (Hiera-B+)Backbone=Hiera-B+, Prompting protocol=first-frame ground-truth mask2024.08 | 77 | — | — | — | |
| SAM 2.1-B+2025.01 | 77 | — | — | — | |
| SAM 2.1Size=Small, Base Version=2.12024.10 | 76.9 | 73.3 | 80.5 | — | |
| SAM 22026.07 | 76.7 | — | — | — | |
| SAM 2.1Size=Tiny, Base Version=2.12024.10 | 76.3 | 72.7 | 79.8 | — | |
| SAM 22024.10 | 76 | 72.6 | 79.3 | — | |
| SAM 2Size=Large, Base Version=2.02024.10 | 75.5 | 72.2 | 78.9 | — | |
| SAM 2Size=Tiny, Base Version=2.02024.10 | 74.6 | 71.1 | 78 | — | |
| SAM 2Size=Small, Base Version=2.02024.10 | 74.6 | 71 | 78.1 | — | |
| SAM 2Size=Base+, Base Version=2.02024.10 | 74.6 | 71.2 | 78.1 | — | |
| AHCQ-SAMModel=SAM2-Small, Precision=W6A62025.03 | 74.46 | — | — | — | |
| MemPoolIE (Image Encoder Optimization)=false, MA (Memory Attention Optimization)=true, Speedup=2.04x, Memory interval (delta_t)=52026.02 | 74.4 | — | — | — | |
| SAM 2-B+2025.01 | 74.1 | — | — | — | |
| PTQ4SAMModel=SAM2-Small, Precision=W6A62025.03 | 73.41 | — | — | — | |
| AHCQ-SAMModel=SAM2-Tiny, Precision=W6A62025.03 | 73.23 | — | — | — | |
| PTQ4SAMModel=SAM2-Tiny, Precision=W6A62025.03 | 73.14 | — | — | — | |
| MemPoolIE (Image Encoder Optimization)=false, MA (Memory Attention Optimization)=true, Speedup=2.04x, Memory interval (delta_t)=12026.02 | 72.6 | — | — | — | |
| EdgeTAM2025.01 | 71.7 | — | — | — | |
| ToMe4DMIE (Image Encoder Optimization)=true, MA (Memory Attention Optimization)=false, Speedup=1.14x, Memory interval (delta_t)=12026.02 | 71.7 | — | — | — | |
| ToMe4DMIE (Image Encoder Optimization)=true, MA (Memory Attention Optimization)=false, Speedup=1.14x, Memory interval (delta_t)=52026.02 | 71.7 | — | — | — | |
| QDropModel=SAM2-Small, Precision=W6A62025.03 | 66.5 | — | — | — | |
| AHCQ-SAMModel=SAM2-Base+, Precision=W6A62025.03 | 65.95 | — | — | — | |
| PTQ4SAMModel=SAM2-Base+, Precision=W6A62025.03 | 65.5 | — | — | — | |
| QDropModel=SAM2-Tiny, Precision=W6A62025.03 | 65.16 | — | — | — | |
| Cutie-base+2024.10 | 62.8 | 59.8 | 65.8 | — | |
| Cutie-base+Backbone=base+, Prompting protocol=first-frame ground-truth mask2024.08 | 62.8 | — | — | — | |
| Cutie-base+2025.01 | 62.8 | — | — | — | |
| Cutie-base+Config=base+2025.07 | 62.8 | — | — | — | |
| Cutie-base+Variant=base+2026.07 | 62.8 | — | — | — | |
| Cutie-baseBackbone=base, Prompting protocol=first-frame ground-truth mask2024.08 | 62.7 | — | — | — | |
| Cutie-base2025.01 | 62.7 | — | — | — | |
| Cutie-baseConfig=base2025.07 | 62.7 | — | — | — | |
| Cutie-baseVariant=base2026.07 | 62.7 | — | — | — | |
| STCN2024.10 | 62.5 | 59 | 66 | — | |
| STCNPrompting protocol=first-frame ground-truth mask2024.08 | 62.5 | — | — | — | |
| STCN2025.01 | 62.5 | — | — | — | |
| STCN2025.07 | 62.5 | — | — | — | |
| STCN2026.07 | 62.5 | — | — | — | |
| XMem2024.10 | 62.3 | 58.9 | 65.8 | — | |
| XMemPrompting protocol=first-frame ground-truth mask2024.08 | 62.3 | — | — | — | |
| XMem2025.01 | 62.3 | — | — | — | |
| XMem2025.07 | 62.3 | — | — | — | |
| XMem2026.07 | 62.3 | — | — | — | |
| SwinB-DeAOT2024.10 | 61.8 | 57.2 | 66.3 | — | |
| SwinB-DeAOTBackbone=SwinB, Prompting protocol=first-frame ground-truth mask2024.08 | 61.8 | — | — | — | |
| SwinB-DeAOT2025.01 | 61.8 | — | — | — | |
| SwinB-DeAOT2025.07 | 61.8 | — | — | — | |
| SwinB-DeAOTBackbone=SwinB2026.07 | 61.8 | — | — | — | |
| QDropModel=SAM2-Base+, Precision=W6A62025.03 | 57.95 | — | — | — | |
| ALGMIE (Image Encoder Optimization)=true, MA (Memory Attention Optimization)=false, Speedup=1.76x, Memory interval (delta_t)=52026.02 | 56.5 | — | — | — | |
| DEVA2024.10 | 56.2 | 52.4 | 60.1 | — | |
| DEVAPrompting protocol=first-frame ground-truth mask2024.08 | 56.2 | — | — | — | |
| DEVA2025.01 | 56.2 | — | — | — | |
| DEVA2025.07 | 56.2 | — | — | — | |
| DEVA2026.07 | 56.2 | — | — | — |