Video Question Answering on Video-MME (Long, No Subtitles)
81.8AccuracyGPT-5
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT-5Active=Prop.2026.03 | 81.8 | |
| VideoARM (GPT-o3+GPT-4o)Active=Prop.2026.03 | 81.2 | |
| Claude-Opus-4.5Active=Prop.2026.03 | 77.6 | |
| Video-RLM (Gemini-3-Flash)Active=Prop.2026.03 | 76.2 | |
| GLM-4.5V-106BActive=12B2026.03 | 74.6 | |
| InternVL3.5-241BActive=28B2026.03 | 72.9 | |
| GPT-4oActive=Prop.2026.03 | 65.3 | |
| LLM over CaptionsActive=Prop.+3B2026.03 | 64.2 | |
| Qwen3.5 (uniform, 160 fr.)Active=3B2026.03 | 63.8 | |
| Qwen2-VL + ReQuestLLM Size=8B, #Frames=≤ 512, zero-shot transfer=true2026.07 | 62.4 | |
| MR.Video (Gemini+GPT-4o)Active=Prop.2026.03 | 61.8 | |
| Qwen2-VLLLM Size=8B, #Frames=512, reproduced=true2026.07 | 61.2 | |
| LongVULLM Size=7B, #Frames=1fps2026.07 | 59.5 | |
| LLaVA-Video + ReQuestLLM Size=7B, #Frames=322026.07 | 55.8 | |
| VideoARM (Qwen3-VL-235B)Active=22B2026.03 | 54.9 | |
| NVILALLM Size=8B, #Frames=10242026.07 | 54.8 | |
| VideoTreeLLM Size=–, #Frames=–2026.07 | 54.2 | |
| LLaVa-OneVision + ReQuestLLM Size=7B, #Frames=32, zero-shot transfer=true2026.07 | 52.3 | |
| LLaVA-VideoLLM Size=7B, #Frames=32, reproduced=true2026.07 | 52.2 | |
| Video-RLM (Qwen3.5-3B)Active=3B2026.03 | 50.4 | |
| LLaVa-OneVisionLLM Size=7B, #Frames=32, reproduced=true2026.07 | 49.2 | |
| Frame-VoyagerLLM Size=7B, #Frames=82026.07 | 48.9 | |
| LLoViLLM Size=–, #Frames=–2026.07 | 48.8 | |
| VideoLLaMA2LLM Size=7B, #Frames=162026.07 | 42.1 | |
| TimeSuiteLLM Size=7B, #Frames=1282026.07 | 41.9 | |
| Video-LLaVALLM Size=7B, #Frames=82026.07 | 36.2 | |
| Chat-UniVi-V1.5LLM Size=7B, #Frames=642026.07 | 35.8 | |
| ShareGPT4VideoLLM Size=8B, #Frames=162026.07 | 35 | |
| VideoChat2LLM Size=7B, #Frames=162026.07 | 33.2 |