Video Question Answering on UrbanVideo and VSI-Bench Clean
62Original MetricGemini-1.5-Pro
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini-1.5-ProSize=–, #Fr=322026.03 | 62 | |
| GPT-4oSize=–, #Fr=322026.03 | 59 | |
| ROVASize=72B, #Fr=32, Backbone=Qwen2.5-VL2026.03 | 59 | |
| Video-R1Size=72B, #Fr=322026.03 | 58 | |
| Qwen2.5-VLSize=72B, #Fr=322026.03 | 57 | |
| ROVASize=13B, #Fr=32, Backbone=Qwen2-VL2026.03 | 56 | |
| ROVASize=7B, #Fr=32, Backbone=Embodied-R2026.03 | 55 | |
| Embodied-RSize=7B, #Fr=322026.03 | 54 | |
| Claude-3.5-Son.Size=–, #Fr=322026.03 | 53 | |
| ROVASize=7B, #Fr=32, Backbone=Qwen2.5-VL2026.03 | 53 | |
| Qwen2-VLSize=13B, #Fr=322026.03 | 53 | |
| Video-R1Size=7B, #Fr=322026.03 | 51 | |
| Qwen2.5-VLSize=7B, #Fr=322026.03 | 51 | |
| LLaVA-Video-RSize=7B, #Fr=322026.03 | 48 | |
| ROVASize=8B, #Fr=32, Backbone=InternVL2.52026.03 | 47 | |
| InternVL2.5Size=8B, #Fr=322026.03 | 46 | |
| VideoChat-RSize=7B, #Fr=162026.03 | 45 | |
| LLaVA-VideoSize=7B, #Fr=322026.03 | 44 | |
| MiniCPM-V 2.6Size=8B, #Fr=642026.03 | 43 | |
| VideoLLaMA2Size=7B, #Fr=162026.03 | 36 | |
| VideoChat2Size=7B, #Fr=162026.03 | 34 |