Expert-level Understanding on MMVU MC
75.4AccuracyGPT-4o
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GPT-4oSize=-, Evaluation Frames=642026.03 | 75.4 | 57.8 | |
| Insight-V++Size=7B, Evaluation Frames=642026.03 | 65 | 54.2 | |
| Insight-VSize=7B, Evaluation Frames=642026.03 | 63.9 | 52.9 | |
| Video-R1Size=7B, Evaluation Frames=642026.03 | 63.8 | — | |
| Qwen2.5-VLSize=7B, Evaluation Frames=642026.03 | 60 | 47.3 | |
| LLaVA-OneVisionSize=7B, Evaluation Frames=642026.03 | 49.2 | — | |
| LLaVA-VideoSize=7B, Evaluation Frames=642026.03 | 48.8 | — |