Grounded Video Question-Answering on CG-Bench
7.1mIoUVideoMind
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| VideoMindSize=7B2025.03 | 7.1 | 38.4 | 9.93 | 4.67 | |
| Zoom-ZeroAccess=Open-Source, Model Scale=7B-8B2025.12 | 6.68 | — | 9.3 | 3.62 | |
| VideoMindSize=2B2025.03 | 5.94 | 31 | 8.5 | 4.02 | |
| VideoChat-R1Access=Open-Source, Model Scale=7B-8B2025.12 | 5.91 | — | 8.38 | 2.56 | |
| GPT-4oAccess=Proprietary2025.12 | 5.73 | — | 8.12 | 4.33 | |
| GPT-4o2025.03 | 5.62 | 45.2 | 8.3 | 4.38 | |
| Claude-3.5-Sonnet2025.03 | 3.99 | 40.5 | 5.67 | 2.79 | |
| Gemini-1.5-Pro2025.03 | 3.95 | 37.2 | 5.81 | 2.53 | |
| InternVL2Size=78B2025.03 | 3.91 | 42.2 | 5.05 | 2.64 | |
| Gemini 1.5 ProAccess=Proprietary2025.12 | 3.85 | — | 5.61 | 2.64 | |
| GPT-4o-mini2025.03 | 3.75 | 33.4 | 5.18 | 2.21 | |
| Gemini-1.5-Flash2025.03 | 3.67 | 32.3 | 5.44 | 2.45 | |
| Qwen2-VLSize=72B2025.03 | 3.58 | 41.3 | 5.32 | 3.31 | |
| VITASize=8x7B2025.03 | 3.06 | 33.3 | 3.53 | 2.06 | |
| LongVASize=7B2025.03 | 2.94 | 28.7 | 3.86 | 1.78 | |
| LongVAAccess=Open-Source, Model Scale=7B-8B2025.12 | 2.91 | — | 3.15 | 1.32 | |
| Video-CCAMSize=14B2025.03 | 2.63 | 29.7 | 3.48 | 1.83 | |
| KangarooSize=8B2025.03 | 2.56 | 30.2 | 2.81 | 1.94 | |
| Qwen2.5-VLAccess=Open-Source, Model Scale=7B-8B2025.12 | 2.48 | — | 3.15 | 1.36 | |
| TVG-R1Access=Open-Source, Model Scale=7B-8B2025.12 | 2.43 | — | 3.62 | 1.29 | |
| MiniCPM-v2.6Size=8B2025.03 | 2.35 | 30.1 | 2.61 | 1.04 | |
| ST-LLMSize=7B2025.03 | 2.23 | 23.8 | 2.86 | 1.13 | |
| Chat-UniVi-v1.5Size=13B2025.03 | 2.07 | 25.9 | 2.53 | 1.21 | |
| ShareGPT4VideoSize=16B2025.03 | 1.85 | 26.7 | 2.65 | 1.01 | |
| LLaVA-OVSize=7B2025.03 | 1.63 | 31.1 | 1.78 | 1.08 | |
| VILASize=8B2025.03 | 1.56 | 28.7 | 2.89 | 1.35 | |
| LLaVA-OneVisionAccess=Open-Source, Model Scale=7B-8B2025.12 | 1.56 | — | 1.19 | 1.72 | |
| Videochat2Size=7B2025.03 | 1.28 | 19.3 | 1.98 | 0.94 | |
| VideoLLaMASize=7B2025.03 | 1.21 | 18.4 | 1.87 | 0.84 | |
| Video-LLaVASize=7B2025.03 | 1.13 | 16.2 | 1.96 | 0.59 | |
| Qwen-VL-ChatSize=7B2025.03 | 0.89 | 21.6 | 1.19 | 0.42 |