Long Video Understanding on MLVU 3-120 min
82.1AccuracySeed1.5-VL
Evaluation Results
| Method | Links | |
|---|---|---|
| Seed1.5-VLSize=8B, Input Frames=>=642025.12 | 82.1 | |
| Gemini-2.5-ProInput Frames=>=642025.12 | 81.2 | |
| Eagle2.5Size=8B, Input Frames=>=642025.12 | 77.6 | |
| VideoMem*Size=8B, Input Frames=642025.12 | 77.4 | |
| Video-XL2Size=8B, Input Frames=>=642025.12 | 74.8 | |
| Qwen2.5-VLSize=72B, Input Frames=>=642025.12 | 74.6 | |
| VideoLLaMA3Size=7B, Input Frames=>=642025.12 | 73 | |
| Qwen3-VL*Size=8B, Input Frames=642025.12 | 71.6 | |
| Flow4AgentSize=7B, Input Frames=>=642025.12 | 71.4 | |
| ApolloSize=7B, Input Frames=>=642025.12 | 70.9 | |
| LLaVA-videoSize=7B, Input Frames=>=642025.12 | 70.8 | |
| Qwen2.5-VLSize=7B, Input Frames=>=642025.12 | 70.2 | |
| InternVL3.5Size=8B, Input Frames=>=642025.12 | 70.2 | |
| NVILASize=8B, Input Frames=>=642025.12 | 70.1 | |
| Thinking-QwenVLFrames=1fps (100%)2026.04 | 68.3 | |
| Qwen2.5-VL-7BFrames=1fps2026.04 | 66.9 | |
| Video-XL-7BFrames=1282026.04 | 64.9 | |
| LLaVA-OnevisionSize=7B, Input Frames=>=642025.12 | 64.7 | |
| GPT-4oInput Frames=>=642025.12 | 64.6 | |
| Video-CCAM-14BFrames=962026.04 | 63.1 | |
| TimeChat-Online-7BFrames=1fps (100%)2026.04 | 62.6 | |
| VISTA-7BFrames=-2026.04 | 62.1 | |
| Dispider-7BFrames=1fps2026.04 | 61.7 | |
| Kangaroo-7BFrames=642026.04 | 61 | |
| Thinking-QwenVLFrames=1fps (↓93.75%)2026.04 | 59.6 | |
| LongVASize=7B, Input Frames=>=642025.12 | 56.3 | |
| LongVA-7BFrames=1282026.04 | 56.3 | |
| VideoNSASize=7B, Input Frames=>=642025.12 | 51.8 | |
| GPT-4VInput Frames=>=642025.12 | 49.2 | |
| VideoLLaMA2Size=7B, Input Frames=>=642025.12 | 48.5 | |
| VideoChat2-7BFrames=162026.04 | 47.9 | |
| Video-LLaVASize=7B, Input Frames=>=642025.12 | 47.3 | |
| ShareGPT4VideoSize=8B, Input Frames=>=642025.12 | 46.4 | |
| LLaVA-Next-VideoSize=7B, Input Frames=>=642025.12 | 39.3 | |
| LLaMA-VID-7BFrames=1fps2026.04 | 33.2 | |
| MovieChat-7BFrames=20482026.04 | 25.8 |