Video Understanding on MLVU (Accuracy, Avg., Perf.)
64.7AccuracyLLaVA-OneVision-7B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LLaVA-OneVision-7BRetention Ratio=100%, Sampled Frames=322026.04 | 64.7 | 59 | 100 | |
| TangoRetention Ratio=20%, Base Model=LLaVA-OneVision-7B, Sampled Frames=322026.04 | 64.1 | 58.9 | 99.7 | |
| TangoRetention Ratio=15%, Base Model=LLaVA-OneVision-7B, Sampled Frames=322026.04 | 64 | 58.5 | 99.1 | |
| FastVIDRetention Ratio=20%, Base Model=LLaVA-OneVision-7B, Sampled Frames=322026.04 | 63.7 | 58.5 | 99 | |
| TangoRetention Ratio=10%, Base Model=LLaVA-OneVision-7B, Sampled Frames=322026.04 | 63.5 | 58.4 | 98.9 | |
| FastVIDRetention Ratio=15%, Base Model=LLaVA-OneVision-7B, Sampled Frames=322026.04 | 63.3 | 58 | 98.3 | |
| HoliTomRetention Ratio=20%, Base Model=LLaVA-OneVision-7B, Sampled Frames=322026.04 | 63 | 58.2 | 98.6 | |
| HoliTomRetention Ratio=15%, Base Model=LLaVA-OneVision-7B, Sampled Frames=322026.04 | 62.8 | 57.8 | 97.9 | |
| VisionZipRetention Ratio=20%, Base Model=LLaVA-OneVision-7B, Sampled Frames=322026.04 | 62.1 | 56.7 | 96 | |
| VidCom^2Retention Ratio=20%, Base Model=LLaVA-OneVision-7B, Sampled Frames=322026.04 | 62 | 56.8 | 96.3 | |
| HoliTomRetention Ratio=10%, Base Model=LLaVA-OneVision-7B, Sampled Frames=322026.04 | 61.6 | 57.1 | 96.7 | |
| FastVIDRetention Ratio=10%, Base Model=LLaVA-OneVision-7B, Sampled Frames=322026.04 | 61.2 | 56.9 | 96.4 | |
| VidCom^2Retention Ratio=15%, Base Model=LLaVA-OneVision-7B, Sampled Frames=322026.04 | 61 | 55.7 | 94.3 | |
| VisionZipRetention Ratio=15%, Base Model=LLaVA-OneVision-7B, Sampled Frames=322026.04 | 59.8 | 54.8 | 92.8 | |
| VisionZipRetention Ratio=10%, Base Model=LLaVA-OneVision-7B, Sampled Frames=322026.04 | 59 | 53.8 | 91.1 | |
| FastVRetention Ratio=20%, Base Model=LLaVA-OneVision-7B, Sampled Frames=322026.04 | 59 | 54.8 | 92.9 | |
| VidCom^2Retention Ratio=10%, Base Model=LLaVA-OneVision-7B, Sampled Frames=322026.04 | 57.4 | 52.7 | 89.3 | |
| FastVRetention Ratio=15%, Base Model=LLaVA-OneVision-7B, Sampled Frames=322026.04 | 57.3 | 52.6 | 89.1 | |
| DARTRetention Ratio=10%, Base Model=LLaVA-OneVision-7B, Sampled Frames=322026.04 | 55.4 | 49.3 | 83.5 | |
| FastVRetention Ratio=10%, Base Model=LLaVA-OneVision-7B, Sampled Frames=322026.04 | 54.6 | 49.8 | 84.4 |