Video Question Answering on MLVU (dev)
78.1AccuracyQwen3-VL
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3-VLModel Class=8B2026.05 | 78.1 | |
| LLaVA-OV-2Model Class=8B2026.05 | 76.6 | |
| Keye-VL-1.5Model Class=8B2026.05 | 75 | |
| A.I.R. + InternVL-3LLM Size=8B, #Frames=≤ 322025.10 | 74.5 | |
| InternVL-3 + MDP3LLM Size=8B, #Frames=32, Source=Reproduced2025.10 | 74 | |
| InternVL-3 (reported)LLM Size=8B, #Frames=max: 64, Source=Reported2025.10 | 71.4 | |
| InternVL-3.5Model Class=8B2026.05 | 71 | |
| QwenVL-2.5 (reported)LLM Size=7B, #Frames=max: 768, Source=Reported2025.10 | 70.2 | |
| A.I.R. + LLaVA-OneVisionLLM Size=7B, #Frames=≤ 322025.10 | 69.3 | |
| InternVL-3 (reproduced)LLM Size=8B, #Frames=32, Source=Reproduced2025.10 | 68.4 | |
| LLaVA-OneVision + MDP3LLM Size=7B, #Frames=32, Source=Reproduced2025.10 | 68.3 | |
| LLaVA-OneVision-7B + ReKVFrames=0.5/0.2 fps2025.05 | 68.2 | |
| LiveVLMFrames=0.5/0.2 fps2025.05 | 68.1 | |
| A.I.R. + QwenVL-2.5LLM Size=7B, #Frames=≤ 322025.10 | 67.5 | |
| LLaVA-OneVision-7B + StreamMemFrames=0.5/0.2 fps2025.05 | 66.9 | |
| LLaVA-OneVision + BOLTLLM Size=7B, #Frames=32, Source=Reported2025.10 | 66.8 | |
| PLMModel Class=8B2026.05 | 66.4 | |
| QwenVL-2.5 + MDP3LLM Size=7B, #Frames=32, Source=Reproduced2025.10 | 66.2 | |
| VideoXL-7BFrames=1282025.05 | 64.9 | |
| LLaVA-OneVision (reported)LLM Size=7B, #Frames=32*, Source=Reported2025.10 | 64.7 | |
| LLaVA-OneVision-7BFrames=322025.05 | 64.7 | |
| LLaVA-OneVision (reproduced)LLM Size=7B, #Frames=32, Source=Reproduced2025.10 | 62.4 | |
| LLaVA-OV-1.5Model Class=8B2026.05 | 62.1 | |
| Dispider-7BFrames=1 fps†2025.05 | 61.7 | |
| Kangaroo-8BFrames=642025.05 | 61 | |
| QwenVL-2.5 (reproduced)LLM Size=7B, #Frames=32, Source=Reproduced2025.10 | 59.3 | |
| LongVA-7BFrames=1282025.05 | 56.3 | |
| VILA-1.5 + Q-FrameLLM Size=8B, #Frames=8, Source=Reported2025.10 | 54.4 | |
| A.I.R. + VILA-1.5LLM Size=8B, #Frames=82025.10 | 54.2 | |
| VILA-1.5 + MDP3LLM Size=8B, #Frames=8, Source=Reproduced2025.10 | 52.3 | |
| VILA-1.5 + Frame-VoyagerLLM Size=8B, #Frames=8, Source=Reported2025.10 | 49.8 | |
| VILA-1.5 (reported)LLM Size=7B, #Frames=8, Source=Reported2025.10 | 46.3 | |
| VILA-1.5 (reproduced)LLM Size=8B, #Frames=8, Source=Reproduced2025.10 | 44.7 | |
| MovieChat-7BFrames=20482025.05 | 25.8 |