Multiple-choice question answering on MVBench
58.54AccuracyVanilla
Evaluation results
| Method | Links | ||
|---|---|---|---|
| VanillaRetention=100%2026.04 | 58.54 | — | |
| Holitom+SToPRetention=15%2026.04 | 57.84 | 0.95 | |
| FastVid+SToPRetention=10%2026.04 | 57.79 | 2.9 | |
| FastVid+SToPRetention=15%2026.04 | 57.76 | 1.18 | |
| VisionZip+SToPRetention=15%2026.04 | 57.71 | 1.6 | |
| HolitomRetention=15%2026.04 | 57.63 | 1.31 | |
| FastVidRetention=15%2026.04 | 57.55 | 3.15 | |
| Holitom+SToPRetention=10%2026.04 | 57.45 | 2.02 | |
| VisionZip+SToPRetention=10%2026.04 | 57.34 | 3.34 | |
| PruneVidRetention=15%2026.04 | 57.26 | 2.32 | |
| HolitomRetention=10%2026.04 | 57.11 | 3.21 | |
| PruneVidRetention=10%2026.04 | 56.74 | 3.17 | |
| VisionZipRetention=15%2026.04 | 56.42 | 3.23 | |
| FastVidRetention=10%2026.04 | 56.42 | 5.12 | |
| VisionZipRetention=10%2026.04 | 54.16 | 7.36 |