Reasoning Video Object Segmentation on ReasonVOS (test)
65.8J & F ScoreMolmo2-8B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Molmo2-8BAccess=Open weights, Open data (no distillation), Open code2026.01 | 65.8 | — | 70.8 | 68.6 | |
| Molmo2-8BCategory=Fully open2026.03 | 65.8 | — | 70.8 | 68.6 | |
| MolmoPoint-8BCategory=MolmoPoint2026.03 | 64.7 | — | 68.8 | 67 | |
| Molmo2-O-7BAccess=Open weights, Open data (no distillation), Open code2026.01 | 62.6 | — | 67.5 | 65.1 | |
| Molmo2-O-7BCategory=Fully open2026.03 | 62.6 | — | 67.5 | 65.1 | |
| Molmo2-4BAccess=Open weights, Open data (no distillation), Open code2026.01 | 61.9 | — | 66.5 | 64 | |
| Molmo2-4BCategory=Fully open2026.03 | 61.9 | — | 66.5 | 64 | |
| Sa2VA-8BAccess=Specialized open models2026.01 | 55.5 | — | — | — | |
| Sa2VA-8BCategory=Specialized open models2026.03 | 55.5 | — | — | — | |
| Gemini 3 ProAccess=API call only2026.01 | 52.6 | — | 48.5 | 42.1 | |
| Gemini 3 ProCategory=API call only2026.03 | 52.6 | — | 48.5 | 42.1 | |
| VideoMolmo-7BAccess=Specialized open models2026.01 | 51.1 | — | 50.3 | — | |
| VideoMolmo-7BCategory=Fully open2026.03 | 51.1 | — | 50.3 | — | |
| Sa2VA-Qwen3-VL-4BAccess=Specialized open models2026.01 | 50 | — | — | — | |
| Sa2VA-Qwen3-VL-4BCategory=Specialized open models2026.03 | 50 | — | — | — | |
| VideoLISAAccess=Specialized open models2026.01 | 47.5 | — | — | — | |
| VideoLISACategory=Specialized open models2026.03 | 47.5 | — | — | — | |
| Molmo + SAM 2Access=Specialized open models2026.01 | 45.7 | — | 50.3 | — | |
| Molmo + SAM 2Category=Fully open2026.03 | 45.7 | — | 50.3 | — | |
| Gemini 2.5 ProAccess=API call only2026.01 | 44 | — | 50.2 | 42.4 | |
| Gemini 2.5 ProCategory=API call only2026.03 | 44 | — | 50.2 | 42.4 | |
| VideoGLaMMAccess=Specialized open models2026.01 | 33.9 | — | — | — | |
| VideoGLaMMCategory=Specialized open models2026.03 | 33.9 | — | — | — | |
| Gemini 2.5 FlashAccess=API call only2026.01 | 26.5 | — | 25.8 | 21 | |
| Qwen3-VL-4BAccess=Open weights only2026.01 | 26.5 | — | 17 | 13.5 | |
| Gemini 2.5 FlashCategory=API call only2026.03 | 26.5 | — | 25.8 | 21 | |
| Qwen3-VL-4BCategory=Open weights only2026.03 | 26.5 | — | 17 | 13.5 | |
| Qwen3-VL-8BAccess=Open weights only2026.01 | 24.9 | — | 22.3 | 17.5 | |
| Qwen3-VL-8BCategory=Open weights only2026.03 | 24.9 | — | 22.3 | 17.5 | |
| GPT-5Access=API call only2026.01 | 24.7 | — | 13.6 | 10.7 | |
| GPT-5Category=API call only2026.03 | 24.7 | — | 13.6 | 10.7 | |
| GPT-5 miniAccess=API call only2026.01 | 14.6 | — | 4.2 | 3.4 | |
| GPT-5 miniCategory=API call only2026.03 | 14.6 | — | 4.2 | 3.4 | |
| Seg-ReSearch-8BParameters=8B, Search Engine=Enabled2026.02 | 0.632 | 0.602 | 0.662 | — | |
| Qwen3-VL-8B*Parameters=8B2026.02 | 0.569 | 0.538 | 0.6 | — | |
| OneThinker-8BParameters=8B, Venue=arXiv'252026.02 | 0.549 | 0.511 | 0.587 | — | |
| RGA3-7BParameters=7B, Venue=ICCV'252026.02 | 0.536 | 0.513 | 0.56 | — | |
| GLUS-7BParameters=7B, Venue=CVPR'252026.02 | 0.499 | 0.475 | 0.524 | — | |
| VideoLISA-3.8BParameters=3.8B, Venue=NeurIPS'242026.02 | 0.475 | 0.451 | 0.499 | — |