Video Understanding on Video-MME (Short, Medium, Long, Overall, Avg., Perf.)
71.9Performance (Short)LLaVA-OneVision-7B
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| LLaVA-OneVision-7BRetention Ratio=100%, Sampled Frames=32, Subtitle Setting=w/o sub2026.04 | 71.9 | 56.3 | 49.6 | 59.3 | 59 | 100 | |
| TangoRetention Ratio=20%, Base Model=LLaVA-OneVision-7B, Sampled Frames=32, Subtitle Setting=w/o sub2026.04 | 71.3 | 56.1 | 48.9 | 58.8 | 58.9 | 99.7 | |
| HoliTomRetention Ratio=20%, Base Model=LLaVA-OneVision-7B, Sampled Frames=32, Subtitle Setting=w/o sub2026.04 | 71.2 | 53.8 | 49.4 | 58.1 | 58.2 | 98.6 | |
| FastVIDRetention Ratio=20%, Base Model=LLaVA-OneVision-7B, Sampled Frames=32, Subtitle Setting=w/o sub2026.04 | 70.2 | 55.8 | 49.4 | 58.5 | 58.5 | 99 | |
| TangoRetention Ratio=15%, Base Model=LLaVA-OneVision-7B, Sampled Frames=32, Subtitle Setting=w/o sub2026.04 | 69.8 | 55.6 | 49.7 | 58.3 | 58.5 | 99.1 | |
| VidCom^2Retention Ratio=20%, Base Model=LLaVA-OneVision-7B, Sampled Frames=32, Subtitle Setting=w/o sub2026.04 | 69.6 | 56 | 49.3 | 58.3 | 56.8 | 96.3 | |
| FastVIDRetention Ratio=15%, Base Model=LLaVA-OneVision-7B, Sampled Frames=32, Subtitle Setting=w/o sub2026.04 | 69.1 | 55.4 | 48.9 | 57.8 | 58 | 98.3 | |
| TangoRetention Ratio=10%, Base Model=LLaVA-OneVision-7B, Sampled Frames=32, Subtitle Setting=w/o sub2026.04 | 68.9 | 56.8 | 49.8 | 58.5 | 58.4 | 98.9 | |
| HoliTomRetention Ratio=15%, Base Model=LLaVA-OneVision-7B, Sampled Frames=32, Subtitle Setting=w/o sub2026.04 | 68.1 | 53.1 | 48.2 | 56.5 | 57.8 | 97.9 | |
| HoliTomRetention Ratio=10%, Base Model=LLaVA-OneVision-7B, Sampled Frames=32, Subtitle Setting=w/o sub2026.04 | 66.6 | 53.8 | 48.6 | 56.3 | 57.1 | 96.7 | |
| VidCom^2Retention Ratio=15%, Base Model=LLaVA-OneVision-7B, Sampled Frames=32, Subtitle Setting=w/o sub2026.04 | 66.3 | 54.8 | 48.2 | 56.4 | 55.7 | 94.3 | |
| FastVIDRetention Ratio=10%, Base Model=LLaVA-OneVision-7B, Sampled Frames=32, Subtitle Setting=w/o sub2026.04 | 65.1 | 55.3 | 48.6 | 56.3 | 56.9 | 96.4 | |
| VisionZipRetention Ratio=20%, Base Model=LLaVA-OneVision-7B, Sampled Frames=32, Subtitle Setting=w/o sub2026.04 | 65.1 | 55.1 | 47.9 | 56 | 56.7 | 96 | |
| FastVRetention Ratio=20%, Base Model=LLaVA-OneVision-7B, Sampled Frames=32, Subtitle Setting=w/o sub2026.04 | 63.8 | 51.4 | 45.9 | 53.7 | 54.8 | 92.9 | |
| VisionZipRetention Ratio=15%, Base Model=LLaVA-OneVision-7B, Sampled Frames=32, Subtitle Setting=w/o sub2026.04 | 63.1 | 53.6 | 47.3 | 54.7 | 54.8 | 92.8 | |
| VidCom^2Retention Ratio=10%, Base Model=LLaVA-OneVision-7B, Sampled Frames=32, Subtitle Setting=w/o sub2026.04 | 61.7 | 51.7 | 47.7 | 53.7 | 52.7 | 89.3 | |
| VisionZipRetention Ratio=10%, Base Model=LLaVA-OneVision-7B, Sampled Frames=32, Subtitle Setting=w/o sub2026.04 | 61.2 | 52.3 | 47.2 | 53.6 | 53.8 | 91.1 | |
| FastVRetention Ratio=15%, Base Model=LLaVA-OneVision-7B, Sampled Frames=32, Subtitle Setting=w/o sub2026.04 | 59.7 | 51 | 45 | 51.9 | 52.6 | 89.1 | |
| FastVRetention Ratio=10%, Base Model=LLaVA-OneVision-7B, Sampled Frames=32, Subtitle Setting=w/o sub2026.04 | 54.7 | 49 | 43.7 | 49.1 | 49.8 | 84.4 | |
| DARTRetention Ratio=10%, Base Model=LLaVA-OneVision-7B, Sampled Frames=32, Subtitle Setting=w/o sub2026.04 | 54.4 | 49 | 44 | 49.1 | 49.3 | 83.5 |