Video Reasoning on VideoMMMU (test)
65.8AccuracyClaude-3.5
Evaluation Results
| Method | Links | |
|---|---|---|
| Claude-3.5Frame Count=16-frame, Activation Replay=false2025.11 | 65.8 | |
| GPT-4oFrame Count=16-frame, Activation Replay=false2025.11 | 61.2 | |
| Video-R1-7B + replayFrame Count=16-frame, Activation Replay=true2025.11 | 53.8 | |
| Video-R1-7BFrame Count=16-frame, Activation Replay=false2025.11 | 49.8 | |
| Qwen2.5-VL-7BFrame Count=16-frame, Activation Replay=false2025.11 | 47.4 | |
| LLaVA-OV-7BFrame Count=16-frame, Activation Replay=false2025.11 | 33.9 |