Video Question Answering on MVBench, VideoMME, LVB, MLVU v1 (test val)
62.3MVBench ScoreVanilla
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| VanillaBackbone=LLaVA-Video-7B, Ret.=100%2026.05 | 62.3 | 64.4 | 59.9 | 68.2 | 100 | |
| FastVIDBackbone=LLaVA-Video-7B, Ret.=25%2026.05 | 61.1 | 63.8 | 57.7 | 66.3 | 97.6 | |
| HoliTomBackbone=LLaVA-Video-7B, Ret.=25%2026.05 | 60.9 | 62.7 | 57.8 | 65.9 | 97 | |
| OTT-VidBackbone=LLaVA-Video-7B, Ret.=25%2026.05 | 60.8 | 62.2 | 58.3 | 66.7 | 97.5 | |
| FlashVIDBackbone=LLaVA-Video-7B, Ret.=25%2026.05 | 59.9 | 61.7 | 58.8 | 66.3 | 96.8 | |
| HoliTomBackbone=LLaVA-Video-7B, Ret.=10%2026.05 | 59.8 | 61.2 | 55.9 | 62.9 | 94.1 | |
| FastVIDBackbone=LLaVA-Video-7B, Ret.=10%2026.05 | 59.7 | 60.2 | 56.8 | 63.3 | 94.2 | |
| FlashVIDBackbone=LLaVA-Video-7B, Ret.=10%2026.05 | 59.3 | 59.9 | 56.4 | 63.4 | 93.8 | |
| OTT-VidBackbone=LLaVA-Video-7B, Ret.=10%2026.05 | 59.2 | 61.5 | 55.8 | 64.4 | 94.5 | |
| HoliTomBackbone=LLaVA-OV-7B, Ret.=25%2026.05 | 58.5 | 58.9 | 57.1 | 63.1 | 100.4 | |
| VanillaBackbone=LLaVA-OV-7B, Ret.=100%2026.05 | 58.4 | 58.6 | 56.4 | 63.3 | 100 | |
| FlashVIDBackbone=LLaVA-OV-7B, Ret.=25%2026.05 | 58.4 | 58.2 | 57.1 | 63.4 | 100.2 | |
| FastVIDBackbone=LLaVA-OV-7B, Ret.=25%2026.05 | 58.3 | 58 | 55.8 | 61.4 | 98.7 | |
| UniCompBackbone=LLaVA-Video-7B, Ret.=25%2026.05 | 58.3 | 60.8 | 58.3 | 65.1 | 95.1 | |
| OTT-VidBackbone=LLaVA-OV-7B, Ret.=25%2026.05 | 58 | 58.2 | 56.9 | 63.5 | 100 | |
| UniCompBackbone=LLaVA-OV-7B, Ret.=25%2026.05 | 57.7 | 58.9 | 57.7 | 62.4 | 100 | |
| HoliTomBackbone=LLaVA-OV-7B, Ret.=10%2026.05 | 57 | 57.5 | 56.2 | 60.4 | 97.7 | |
| FastVIDBackbone=LLaVA-OV-7B, Ret.=10%2026.05 | 57 | 56.8 | 55.1 | 60.3 | 96.8 | |
| OTT-VidBackbone=LLaVA-OV-7B, Ret.=10%2026.05 | 56.6 | 57.1 | 56.1 | 61.5 | 97.8 | |
| UniCompBackbone=LLaVA-OV-7B, Ret.=10%2026.05 | 56.4 | 58 | 57.4 | 60.9 | 98.4 | |
| FlashVIDBackbone=LLaVA-OV-7B, Ret.=10%2026.05 | 56.3 | 56.7 | 54.2 | 61.9 | 96.8 | |
| UniCompBackbone=LLaVA-Video-7B, Ret.=10%2026.05 | 55.9 | 59.3 | 57 | 64.8 | 93 |