Video Question Answering on MMVU mc
75.4AccuracyGPT-4o
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4oFrames=642026.01 | 75.4 | |
| Qwen2-VL-7B-InstructFrames=2fps2026.01 | 65.6 | |
| Qwen2.5-VL-7B+TIR-FlowFrames=322026.01 | 64.3 | |
| Video-R1-7BFrames=322026.01 | 64.2 | |
| Qwen2.5-VL-7BFrames=322026.01 | 61.3 | |
| LLaVA-Video-7B+TIR-FlowFrames=322026.01 | 56.4 | |
| LLaVA-onevision-7BFrames=322026.01 | 49.2 | |
| LLaVA-Video-7BFrames=322026.01 | 48.8 | |
| VideoLLaMA3-7BFrames=1802026.01 | 44.1 |