Video Reasoning on MMVU Multiple-choice (test)
75.4AccuracyGPT-4o
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4oFrames=-2026.04 | 75.4 | |
| GPT-4oFrame Count=16-frame, Activation Replay=false2025.11 | 75.4 | |
| Video-ToCFrames=642026.04 | 66.5 | |
| Video-ToCFrames=162026.04 | 66.1 | |
| Video-ToCFrames=322026.04 | 66.1 | |
| VideoChat-R1Frames=162026.04 | 65.8 | |
| Video-ToC-SFTFrames=322026.04 | 65.4 | |
| Video-ToC-SFTFrames=642026.04 | 65.4 | |
| Video-ToC-SFTFrames=162026.04 | 65.3 | |
| Video-R1-7B + replayFrame Count=16-frame, Activation Replay=true2025.11 | 65 | |
| Video-R1Frames=162026.04 | 64.2 | |
| Video-R1-7BFrame Count=16-frame, Activation Replay=false2025.11 | 64.2 | |
| Video-R1Frames=322026.04 | 63.8 | |
| Video-R1Frames=642026.04 | 63.8 | |
| Video-R1-SFTFrames=322026.04 | 63.5 | |
| Video-R1-SFTFrames=642026.04 | 61.6 | |
| Video-R1-SFTFrames=162026.04 | 61.3 | |
| Baseline (Qwen2.5-VL-7B)Frames=322026.04 | 60 | |
| Baseline (Qwen2.5-VL-7B)Frames=642026.04 | 60 | |
| Baseline (Qwen2.5-VL-7B)Frames=162026.04 | 59.2 | |
| Qwen2.5-VL-7BFrame Count=16-frame, Activation Replay=false2025.11 | 50.1 | |
| LLaVA-OneVision-7BFrames=-2026.04 | 49.2 | |
| LLaVA-OV-7BFrame Count=16-frame, Activation Replay=false2025.11 | 49.2 | |
| TinyLLaVA-Video-R1Frames=162026.04 | 46.9 | |
| VideoLLaMA2-7BFrames=-2026.04 | 44.8 |