Long Video Understanding on MLVU 2024 (test)
54.9AccuracyGPT-4o
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT-4oSize=-, Frames=0.5 fps / 3842025.08 | 54.9 | |
| Video-MTRSize=7B, Frames=802025.08 | 50.4 | |
| Video-MTRSize=7B, Frames=642025.08 | 49.8 | |
| Video-MTRSize=7B, Frames=322025.08 | 48.4 | |
| Video-R1Size=7B, Frames=642025.08 | 47.6 | |
| VideoLLaMA2Size=8×7B, Frames=82025.08 | 45.6 | |
| Video-XLSize=7B, Frames=128 / 2562025.08 | 45.6 | |
| Video-R1Size=7B, Frames=322025.08 | 45.4 | |
| Qwen2.5-VL-7BSize=7B, Frames=802025.08 | 45.2 | |
| Video-CCAMSize=9B, Frames=962025.08 | 42.9 | |
| Qwen2.5-VL-7BSize=7B, Frames=642025.08 | 41.8 | |
| Qwen2.5-VL-7BSize=7B, Frames=322025.08 | 41.6 | |
| LongVASize=7B, Frames=128 / 2562025.08 | 41.1 | |
| Video-LLaVASize=7B, Frames=82025.08 | 30.7 | |
| VideoChat2Size=7B, Frames=162025.08 | 30.1 |