Video Spatial Understanding on VSI-Bench 500 QA 1.0
49.7AccuracyCoCoSI
Evaluation results
| Method | Links | |
|---|---|---|
| CoCoSIBackbone=Gemini-based, Training-free=true, Agentic Collaboration=true, CogMap=true2026.06 | 49.7 | |
| CoCoSIBackbone=Gemini-2.5-Flash, Training-free=true, Agentic Collaboration=true, CogMap=true2026.06 | 49.7 | |
| Single-Agent BaselineBackbone=Gemini-based, Training-free=true, Agentic Collaboration=false, CogMap=true2026.06 | 44.9 | |
| Single-Agent BaselineBackbone=Gemini-2.5-Flash, Training-free=true, Agentic Collaboration=false, CogMap=true2026.06 | 44.9 | |
| TraveLERBackbone=Gemini-based, Training-free=true, Agentic Collaboration=true, CogMap=false2026.06 | 44.1 | |
| TraveLERBackbone=Gemini-2.5-Flash, Training-free=true, Agentic Collaboration=true, CogMap=false2026.06 | 44.1 | |
| VCABackbone=Gemini-based, Training-free=true, Agentic Collaboration=false, CogMap=false2026.06 | 43.6 | |
| VCABackbone=Gemini-2.5-Flash, Training-free=true, Agentic Collaboration=false, CogMap=false2026.06 | 43.6 | |
| VideoAgentBackbone=Gemini-based, Training-free=true, Agentic Collaboration=false, CogMap=false2026.06 | 43.3 | |
| VideoAgentBackbone=Gemini-2.5-Flash, Training-free=true, Agentic Collaboration=false, CogMap=false2026.06 | 43.3 | |
| CoCoSIBackbone=GPT-based, Training-free=true, Agentic Collaboration=true, CogMap=true2026.06 | 43 | |
| CoCoSIBackbone=Qwen-VL-based, Training-free=true, Agentic Collaboration=true, CogMap=true2026.06 | 41.1 | |
| CoCoSIBackbone=Qwen2.5-VL-32B, Training-free=true, Agentic Collaboration=true, CogMap=true2026.06 | 41.1 | |
| Single-Agent BaselineBackbone=GPT-based, Training-free=true, Agentic Collaboration=false, CogMap=true2026.06 | 39.7 | |
| TraveLERBackbone=GPT-based, Training-free=true, Agentic Collaboration=true, CogMap=false2026.06 | 39.3 | |
| VCABackbone=GPT-based, Training-free=true, Agentic Collaboration=false, CogMap=false2026.06 | 38.9 | |
| VideoAgentBackbone=GPT-based, Training-free=true, Agentic Collaboration=false, CogMap=false2026.06 | 38.4 | |
| Single-Agent BaselineBackbone=Qwen-VL-based, Training-free=true, Agentic Collaboration=false, CogMap=true2026.06 | 36.6 | |
| Single-Agent BaselineBackbone=Qwen2.5-VL-32B, Training-free=true, Agentic Collaboration=false, CogMap=true2026.06 | 36.6 | |
| TraveLERBackbone=Qwen-VL-based, Training-free=true, Agentic Collaboration=true, CogMap=false2026.06 | 36.2 | |
| TraveLERBackbone=Qwen2.5-VL-32B, Training-free=true, Agentic Collaboration=true, CogMap=false2026.06 | 36.2 | |
| VCABackbone=Qwen-VL-based, Training-free=true, Agentic Collaboration=false, CogMap=false2026.06 | 35.7 | |
| VCABackbone=Qwen2.5-VL-32B, Training-free=true, Agentic Collaboration=false, CogMap=false2026.06 | 35.7 | |
| VideoAgentBackbone=Qwen-VL-based, Training-free=true, Agentic Collaboration=false, CogMap=false2026.06 | 35.4 | |
| VideoAgentBackbone=Qwen2.5-VL-32B, Training-free=true, Agentic Collaboration=false, CogMap=false2026.06 | 35.4 |