Video Understanding on MVBench, EgoSchema, MLVU, LongVideoBench, VideoMME
56.3Overall ScoreVanilla
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| VanillaPrefill (ms)=701.2 (1×), TTFT (ms)=1104.7, Throughput (token/s)=27.62026.03 | 56.3 | — | — | |
| LLaVA-OV-7BRetention Ratio=100%2026.03 | 56.3 | 100 | — | |
| OursRetention Ratio=15%/7.5%2026.03 | 56.1 | 99.6 | — | |
| HoliTomRetention Ratio=15%/7.5%2026.03 | 56 | 99.5 | — | |
| OursRetention Ratio=10%/5%2026.03 | 55.4 | 98.4 | — | |
| HoliTomRetention Ratio=10%/5%2026.03 | 55.3 | 98.3 | — | |
| Ours (w/o M)Retention Ratio=10%2026.03 | 55.3 | 98.3 | — | |
| FastVIDRetention Ratio=15%2026.03 | 54.4 | 96.6 | — | |
| FastVIDRetention Ratio=10%2026.03 | 54.2 | 96.2 | — | |
| VisionZipRetention Ratio=15%2026.03 | 54 | 95.9 | — | |
| DyToKRetention Ratio=15%2026.03 | 54 | 95.9 | — | |
| OursRetention Ratio=5%/2.5%2026.03 | 53.7 | 95.4 | — | |
| Ours (w/o M)Retention Ratio=5%2026.03 | 53.4 | 94.9 | — | |
| Qwen2.5-VLRetention Ratio=100%2026.03 | 53.4 | — | 100 | |
| HoliTomRetention Ratio=5%/2.5%2026.03 | 52.9 | 94 | — | |
| DyToKRetention Ratio=10%2026.03 | 52.6 | 93.5 | — | |
| FastVIDRetention Ratio=5%2026.03 | 51.5 | 91.5 | — | |
| VisionZipRetention Ratio=10%2026.03 | 51.3 | 91.2 | — | |
| FsatVRetention Ratio=100%/10%2026.03 | 51.1 | 90.8 | — | |
| Unified Spatiotemporal Token CompressionProcess (ms)=74.0, Prefill (ms)=31.3 (22×), TTFT (ms)=473.8, Throughput (token/s)=35.72026.03 | 50.7 | — | — | |
| OursRetention Ratio=2%/1%2026.03 | 50.7 | 90.1 | — | |
| Ours (w/o M)Retention Ratio=2%2026.03 | 50.4 | 89.5 | — | |
| HoliTomProcess (ms)=88.7, Prefill (ms)=40.5 (17×), TTFT (ms)=497.4, Throughput (token/s)=34.32026.03 | 49.4 | — | — | |
| HoliTomRetention Ratio=2%/1%2026.03 | 49.4 | 87.7 | — | |
| DyToKRetention Ratio=5%2026.03 | 48.9 | 86.8 | — | |
| FastVRetention Ratio=100%/5%2026.03 | 47.7 | 84.7 | — | |
| Ours (w/o M)Retention Ratio=1%2026.03 | 47.4 | 84.2 | — | |
| OursRetention Ratio=1%/0.5%2026.03 | 47.3 | 84.1 | — | |
| FastVidProcess (ms)=8.6, Prefill (ms)=43.1 (16×), TTFT (ms)=446.2, Throughput (token/s)=33.82026.03 | 46.9 | — | — | |
| FastVIDRetention Ratio=2%2026.03 | 46.9 | 83.3 | — | |
| HoliTomRetention Ratio=1%/0.5%2026.03 | 46.7 | 82.9 | — | |
| VisionZipProcess (ms)=35.8, Prefill (ms)=42.1 (17×), TTFT (ms)=451.6, Throughput (token/s)=35.42026.03 | 45.8 | — | — | |
| VisionZipRetention Ratio=5%2026.03 | 45.8 | 81.4 | — | |
| FastVRetention Ratio=100%/2%2026.03 | 45.6 | 81 | — | |
| Ours(w/o M)Retention Ratio=2%2026.03 | 45.6 | — | 85.5 | |
| OursRetention Ratio=2%2026.03 | 45.5 | — | 85.3 | |
| FastVRetention Ratio=100%/1%2026.03 | 44.2 | 78.5 | — | |
| FastVIDRetention Ratio=2%2026.03 | 44 | — | 82.5 | |
| FastVIDRetention Ratio=1%2026.03 | 43.7 | 77.7 | — | |
| DyToKRetention Ratio=2%2026.03 | 43.5 | 77.3 | — | |
| VisionZipRetention Ratio=2%2026.03 | 42.6 | — | 79.8 | |
| OursRetention Ratio=1%2026.03 | 42.6 | — | 79.8 | |
| VisionZipRetention Ratio=2%2026.03 | 42.4 | 75.3 | — | |
| Ours(w/o M)Retention Ratio=1%2026.03 | 42.4 | — | 79.4 | |
| DyToKRetention Ratio=1%2026.03 | 41.3 | 73.3 | — | |
| FastVIDRetention Ratio=1%2026.03 | 41.1 | — | 76.9 | |
| VisionZipRetention Ratio=1%2026.03 | 40.6 | 72.1 | — | |
| VisionZipRetention Ratio=1%2026.03 | 39.5 | — | 74 |