Multi-discipline Long Video Understanding on MLVU
68.9ScoreQwen3-VL-8B-Instruct
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen3-VL-8B-InstructMax Input Frames=64, Retention Ratio=100.0%2026.03 | 68.9 | |
| Qwen3-VL-8B-InstructMax Input Frames=642026.03 | 68.9 | |
| HoPEBackbone=Qwen3-VL-8B-Instruct2025.10 | 68.81 | |
| VideoRoPEBackbone=Qwen3-VL-8B-Instruct2025.10 | 68.31 | |
| MRoPE-IBackbone=Qwen3-VL-8B-Instruct2025.10 | 67.52 | |
| MRoPEBackbone=Qwen3-VL-8B-Instruct2025.10 | 67.34 | |
| MHRoPEBackbone=Qwen3-VL-8B-Instruct2025.10 | 67.2 | |
| V-CASTMax Input Frames=64, Retention Ratio=35%2026.03 | 67.1 | |
| CircleRoPEBackbone=Qwen3-VL-8B-Instruct2025.10 | 66.61 | |
| FastVIDMax Input Frames=64, Retention Ratio=35%2026.03 | 66.1 | |
| Vanilla RoPEBackbone=Qwen3-VL-8B-Instruct2025.10 | 66.01 | |
| VidCom2Max Input Frames=64, Retention Ratio=35%2026.03 | 65.5 | |
| V-CASTMax Input Frames=64, Retention Ratio=25%2026.03 | 65.4 | |
| FastVIDMax Input Frames=64, Retention Ratio=25%2026.03 | 65 | |
| V-CASTMax Input Frames=64, Retention Ratio=15%2026.03 | 64.4 | |
| HoliTomMax Input Frames=64, Retention Ratio=35%2026.03 | 64.4 | |
| VisionZipMax Input Frames=64, Retention Ratio=35%2026.03 | 64.3 | |
| VidCom2Max Input Frames=64, Retention Ratio=25%2026.03 | 64 | |
| Qwen3-VL-8B-InstructMax Input Frames=32, Retention Ratio=100.0%2026.03 | 63.5 | |
| V-CASTMax Input Frames=32, Retention Ratio=25%2026.03 | 63.5 | |
| Qwen3-VL-8B-InstructMax Input Frames=322026.03 | 63.5 | |
| VisionZipMax Input Frames=64, Retention Ratio=25%2026.03 | 63.4 | |
| HoliTomMax Input Frames=64, Retention Ratio=25%2026.03 | 63.4 | |
| FastVIDMax Input Frames=64, Retention Ratio=15%2026.03 | 63.3 | |
| V-CASTMax Input Frames=32, Retention Ratio=35%2026.03 | 63.1 | |
| FlashVIDMax Input Frames=32, Retention Ratio=35%2026.03 | 62.4 | |
| FastVIDMax Input Frames=32, Retention Ratio=35%2026.03 | 62.3 | |
| VidCom2Max Input Frames=32, Retention Ratio=35%2026.03 | 62 | |
| HoliTomMax Input Frames=32, Retention Ratio=35%2026.03 | 62 | |
| HoliTomMax Input Frames=64, Retention Ratio=15%2026.03 | 61.8 | |
| FlashVIDMax Input Frames=32, Retention Ratio=25%2026.03 | 61.7 | |
| VisionZipMax Input Frames=64, Retention Ratio=15%2026.03 | 61.4 | |
| VisionZipMax Input Frames=32, Retention Ratio=35%2026.03 | 61.3 | |
| HoliTomMax Input Frames=32, Retention Ratio=25%2026.03 | 61.2 | |
| VisionZipMax Input Frames=32, Retention Ratio=25%2026.03 | 60.8 | |
| FastVIDMax Input Frames=32, Retention Ratio=25%2026.03 | 60.7 | |
| VidCom2Max Input Frames=32, Retention Ratio=25%2026.03 | 60.6 | |
| VidCom2Max Input Frames=64, Retention Ratio=15%2026.03 | 60.3 | |
| V-CASTMax Input Frames=32, Retention Ratio=15%2026.03 | 60.1 | |
| VisionZipMax Input Frames=32, Retention Ratio=15%2026.03 | 60 | |
| FlashVIDMax Input Frames=32, Retention Ratio=15%2026.03 | 60 | |
| HoliTomMax Input Frames=32, Retention Ratio=15%2026.03 | 59.6 | |
| FastVIDMax Input Frames=32, Retention Ratio=15%2026.03 | 59 | |
| VidCom2Max Input Frames=32, Retention Ratio=15%2026.03 | 57.7 | |
| EchoPruneBackbone=Qwen2.5VL-3B, Frames / Pruning Configuration=F160 (5×) / 20%2026.05 | 51.8 | |
| EchoPruneNumber of Frames (F)=320, Compression Ratio=20x, Token Budget=5% (ultra)2026.05 | 51.4 | |
| EchoPruneBackbone=Qwen2.5VL-7B, Frames / Pruning Configuration=F160 (5×) / 20%2026.05 | 51.4 | |
| RandomBackbone=Qwen2.5VL-7B, Frames / Pruning Configuration=F160 (5×) / 20%2026.05 | 49.7 | |
| MI-PrunerBackbone=Qwen2.5VL-7B, Frames / Pruning Configuration=F160 (5×) / 20%2026.05 | 49.6 | |
| FlashVIDBackbone=Qwen2.5VL-3B, Frames / Pruning Configuration=F160 (5×) / 20%2026.05 | 48.9 | |
| FlashVIDBackbone=Qwen2.5VL-7B, Frames / Pruning Configuration=F160 (5×) / 20%2026.05 | 48.6 | |
| MI-PrunerBackbone=Qwen2.5VL-3B, Frames / Pruning Configuration=F160 (5×) / 20%2026.05 | 48.4 | |
| RandomBackbone=Qwen2.5VL-3B, Frames / Pruning Configuration=F160 (5×) / 20%2026.05 | 48 | |
| Qwen2.5VL-7BBackbone=Qwen2.5VL-7B, Frames / Pruning Configuration=F32 (1×) / 100%2026.05 | 44.6 | |
| Qwen2.5VL-3BBackbone=Qwen2.5VL-3B, Frames / Pruning Configuration=F32 (1×) / 100%2026.05 | 43.5 |