Reasoning Video Object Segmentation on ReVOS 1.0 (test)
0.502Jaccard (J)HyperSeg-3B
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| HyperSeg-3BBackbone=Swin-B, Pre-trained SAM=false2024.11 | 0.502 | 0.558 | 0.53 | |
| VISABackbone=Chat-UniVi-13B, Instruction Tuning=true2024.07 | 0.42 | 0.467 | 0.443 | |
| VISABackbone=LLaVA-13B, Instruction Tuning=true2024.07 | 0.419 | 0.465 | 0.442 | |
| VISABackbone=Chat-UniVi-7B, Instruction Tuning=true2024.07 | 0.406 | 0.454 | 0.43 | |
| VISABackbone=LLaVA-7B, Instruction Tuning=true2024.07 | 0.405 | 0.458 | 0.432 | |
| VISABackbone=Chat-UniVi-13B, Instruction Tuning=false2024.07 | 0.383 | 0.435 | 0.409 | |
| VISA-13BBackbone=ViT-H, Pre-trained SAM=true2024.11 | 0.383 | 0.435 | 0.409 | |
| TrackGPTBackbone=LLaVA-13B, Instruction Tuning=true, Reproduced=true2024.07 | 0.381 | 0.429 | 0.405 | |
| TrackGPT-13BBackbone=ViT-H, Pre-trained SAM=true2024.11 | 0.381 | 0.429 | 0.405 | |
| TrackGPTBackbone=LLaVA-7B, Instruction Tuning=true, Reproduced=true2024.07 | 0.368 | 0.412 | 0.39 | |
| VISABackbone=Chat-UniVi-7B, Instruction Tuning=false2024.07 | 0.367 | 0.417 | 0.392 | |
| VISA-7BBackbone=ViT-H, Pre-trained SAM=true2024.11 | 0.367 | 0.417 | 0.392 | |
| LISABackbone=LLaVA-13B, Instruction Tuning=false, Reproduced=true2024.07 | 0.343 | 0.391 | 0.367 | |
| LISABackbone=LLaVA-7B, Instruction Tuning=false2024.07 | 0.338 | 0.384 | 0.361 | |
| LISA-7BBackbone=ViT-H, Pre-trained SAM=true2024.11 | 0.338 | 0.384 | 0.361 | |
| ReferFormerBackbone=Video-Swin-B, Instruction Tuning=false2024.07 | 0.213 | 0.256 | 0.234 | |
| ReferFormerBackbone=Video-Swin-B, Pre-trained SAM=false2024.11 | 0.213 | 0.256 | 0.234 | |
| MTTRBackbone=Video-Swin-T, Instruction Tuning=false2024.07 | 0.204 | 0.215 | 0.21 | |
| LMPMBackbone=Swin-T, Instruction Tuning=false2024.07 | 0.133 | 0.243 | 0.188 | |
| LMPMBackbone=Swin-T, Pre-trained SAM=false2024.11 | 0.133 | 0.243 | 0.188 | |
| LLaMA-VID+LMPMBackbone=Swin-T, Instruction Tuning=false2024.07 | 0.128 | 0.237 | 0.182 | |
| ReferFormerBackbone=ResNet-50, Instruction Tuning=false2024.07 | 0.119 | 0.138 | 0.128 |