Video Question Answering on LongVideoBench w/o sub. (val)
66.7AccuracyGPT-4o
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4oSize=-, # Frames=1fps2026.04 | 66.7 | |
| Video-RAGSize=72B, # Frames=642026.04 | 65.4 | |
| Gemini 1.5 ProSize=-, # Frames=1fps2026.04 | 64 | |
| InternVL 2.5Size=78B, # Frames=642026.04 | 63.6 | |
| Qwen2.5-VLSize=72B, # Frames=32 / 768∗2026.04 | 62.5 | |
| LLaVA-VideoSize=72B, # Frames=32 / 64∗2026.04 | 61.9 | |
| SVAgentBackbone=Qwen3-VL, Size=8B, # Frames=82026.04 | 61 | |
| SVAgentBackbone=Qwen2.5-VL, Size=7B, # Frames=82026.04 | 60.7 | |
| VgentSize=7B, # Frames=3202026.04 | 59.7 | |
| SVAgentBackbone=Qwen2.5-VL, Size=3B, # Frames=82026.04 | 59.7 | |
| SVAgentBackbone=Qwen3-VL, Size=4B, # Frames=82026.04 | 57 | |
| VideoMindSize=7B, # Frames=322026.04 | 56.3 | |
| Qwen3-VLSize=8B, # Frames=82026.04 | 54.9 | |
| Qwen2.5-VLSize=7B, # Frames=82026.04 | 54.8 | |
| Qwen2.5-VLSize=3B, # Frames=82026.04 | 53 | |
| Qwen3-VLSize=4B, # Frames=82026.04 | 52.5 |