Video Understanding and Retrieval on Shot2Story
48.85Recall@1VideoAgent
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| VideoAgentBackbone=GPT-4o2026.06 | 48.85 | 28.26 | 26.99 | 0.099 | 36 | |
| VideoAgentBackbone=Gemini-2.5-pro2026.06 | 47.24 | 28.21 | 25.74 | 0.136 | 37 | |
| Claude-Sonnet-3.72026.06 | 46.03 | 27.95 | 23.91 | 0.374 | 43 | |
| Gemini-2.5-pro2026.06 | 45.98 | 27.78 | 25.91 | 0.349 | 42 | |
| VideoAgentBackbone=Gemini-2.5-flash2026.06 | 44.93 | 28.25 | 25.07 | 0.028 | 36 | |
| VideoAgentBackbone=Claude-Sonnet-3.72026.06 | 44.27 | 28.18 | 24.81 | 0.147 | 37 | |
| TeaserGen2026.06 | 41.88 | 27.62 | 20.91 | 0.079 | 25 | |
| VideoAgentBackbone=Claude-Sonnet-3.52026.06 | 38.7 | 28.45 | 21.32 | 0.147 | 36 | |
| VideoMind-7B2026.06 | 38.26 | 27.75 | 19.67 | — | 21 | |
| GPT-4o2026.06 | 31.22 | 27.64 | 18.53 | 0.253 | 43 | |
| VideoRAG2026.06 | 31.03 | 15.84 | 14.35 | 0.1 | 67 | |
| Gemini-2.5-flash2026.06 | 30.04 | 28.04 | 16.69 | 0.07 | 39 | |
| Claude-Sonnet-3.52026.06 | 27.28 | 27.35 | 12.72 | 0.375 | 41 | |
| Qwen-2.5-VL-72B-Instruct2026.06 | 18.89 | 27.99 | 10.51 | — | 35 |