Video Question Answering on Video-MME Long Duration 1.0
67.4Accuracy (w/o subtitles)Gemini 1.5 Pro
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemini 1.5 ProCategory=Proprietary Models2026.02 | 67.4 | 77.4 | — | |
| GPT-4o-20240513Category=Proprietary Models2026.02 | 65.3 | 72.1 | — | |
| InternVL2.5-72BCategory=Leading Open-sourced MLLMs2026.02 | 62.6 | 64.8 | — | |
| Qwen2-VL-72BCategory=Leading Open-sourced MLLMs2026.02 | 62.2 | 74.3 | — | |
| LLaVA-Video-72BCategory=Leading Open-sourced MLLMs2026.02 | 61.5 | 72.5 | — | |
| Gemini 1.5 FlashCategory=Proprietary Models2026.02 | 61.1 | 68.8 | — | |
| LLaVA-OV-72BCategory=Leading Open-sourced MLLMs2026.02 | 60 | 62.4 | — | |
| LongVideo-R1 (new)Category=Agent-based Systems, Caption Model=Qwen3-VL-32B-Instruct, Training=Renewed SFT data2026.02 | 58 | 68.6 | — | |
| VCACategory=Agent-based Systems2026.02 | 56.3 | — | — | |
| LongVideo-R1Category=Agent-based Systems2026.02 | 55.8 | 64.4 | — | |
| VideoChat-Flash-7BCategory=Leading Open-sourced MLLMs2026.02 | 55.6 | 63.3 | — | |
| MemVidCategory=Agent-based Systems2026.02 | 55 | — | — | |
| VideoLLaMA3-7BCategory=Leading Open-sourced MLLMs2026.02 | 54.9 | 61 | — | |
| VideoTreeCategory=Agent-based Systems2026.02 | 54.2 | — | — | |
| LiveCC-7BCategory=Leading Open-sourced MLLMs2026.02 | 53.7 | 64.1 | — | |
| VILA-1.5LLM Size=34B2024.11 | 50.8 | 52 | — | |
| Qwen-VL-Max2024.11 | 48.9 | 47 | — | |
| VideoAgentCategory=Agent-based Systems2026.02 | 46.4 | — | — | |
| InternVL-V1.5LLM Params=20B2024.11 | 45.6 | 46.6 | — | |
| LLaVA-NeXT-VideoLLM Params=34B2024.11 | 44.3 | 47.2 | — | |
| LLaVA-NeXTLLM Size=34B, DPO tuning=true2024.11 | 44.3 | 47.2 | — | |
| PPLLAVALLM Params=7B, Multi-image training=true2024.11 | 42.2 | 47.4 | — | |
| PPLLAVALLM Params=7B, Multi-image training=false2024.11 | 38.4 | 44 | — | |
| Qwen-VL-ChatLLM Params=7B2024.11 | 37.8 | 37.9 | — | |
| DynFocusInput=16 f, LLM Size=7B, Resolution=224x224, L=25, K/L=0.82024.11 | 37.7 | 43.6 | — | |
| LLaVA-NeXT-VideoLLM Params=7B2024.11 | 36.6 | 41 | — | |
| Video-LLaVALLM Params=7B2024.11 | 36.2 | 38.1 | — | |
| Video-LLaVAInput=8 f, LLM Size=7B2024.11 | 36.2 | 38.1 | — | |
| Chat-UniVi-V1.5LLM Params=7B2024.11 | 35.8 | 41.8 | — | |
| Chat-UniViLLM Size=7B2024.11 | 35.8 | 41.8 | — | |
| VideoChat2-MistralLLM Params=7B2024.11 | 33.2 | 39.2 | — | |
| VideoChat2Input=16 f, LLM Size=7B2024.11 | 33.2 | 39.2 | — | |
| ST-LLMLLM Params=7B2024.11 | 31.3 | 36.9 | — | |
| ST-LLMInput=16 f, LLM Size=7B2024.11 | 31.3 | 36.9 | — | |
| +HACLsubtitles=with2025.12 | — | — | 53.2 | |
| +HACLsubtitles=without2025.12 | — | — | 51.4 | |
| +SANTAsubtitles=with2025.12 | — | — | 55.4 | |
| +SANTAsubtitles=without2025.12 | — | — | 49.6 | |
| +SFTsubtitles=with2025.12 | — | — | 35.3 | |
| +SFTsubtitles=without2025.12 | — | — | 35 | |
| Chat-UniViLLM Size=7B, Frames=642025.01 | — | — | 40.6 | |
| Chat-UniViLLM Size=7B2024.10 | — | — | 35.8 | |
| DispiderLLM Size=7B, Frames=1 FPS2025.01 | — | — | 57.2 | |
| Ego-R1Category=Agent-based Systems2026.02 | — | 64.9 | — | |
| KangarooLLM Size=8B, Frames=642025.01 | — | — | 56 | |
| LLaVA-Next-VideoLLM Size=7B, Frames=322025.01 | — | — | 46.6 | |
| LLaVA-Videosubtitles=with2025.12 | — | — | 58.3 | |
| LLaVA-Videosubtitles=without2025.12 | — | — | 52.1 | |
| LongVALLM Size=7B, Frames=1282025.01 | — | — | 52.6 | |
| MovieChatLLM Size=7B, Frames=20482025.01 | — | — | 38.2 | |
| MovieChatLLM Size=7B2024.10 | — | — | 33.4 | |
| ShareGPT4VideoLLM Size=8B, Frames=162025.01 | — | — | 39.9 | |
| TimeChatLLM Size=7B, Frames=962025.01 | — | — | 30.2 | |
| TimeChatLLM Size=7B2024.10 | — | — | 26.1 | |
| Video-CCAMLLM Size=14B, Frames=962025.01 | — | — | 53.2 | |
| Video-LLaMA2LLM Size=7B, Frames=162025.01 | — | — | 47.9 | |
| Video-LLaVALLM Size=7B, Frames=82025.01 | — | — | 39.9 | |
| Video-RAG-7BCategory=Agent-based Systems2026.02 | — | 59.8 | — | |
| VideoChat-TLLM Size=7B2024.10 | — | — | 41.9 | |
| VideoChat2LLM Size=7B, Frames=162025.01 | — | — | 39.5 | |
| VideoChat2LLM Size=7B2024.10 | — | — | 33.2 | |
| VideoXLLLM Size=7B, Frames=1282025.01 | — | — | 55.5 |