Multiple-choice question answering on NextQA
80.38AccuracyHolitom+SToP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Holitom+SToPRetention=15%2026.04 | 80.38 | 0.95 | |
| FastVid+SToPRetention=15%2026.04 | 80.3 | 1.18 | |
| VisionZip+SToPRetention=15%2026.04 | 79.92 | 1.6 | |
| Holitom+SToPRetention=10%2026.04 | 79.86 | 2.02 | |
| HolitomRetention=15%2026.04 | 79.74 | 1.31 | |
| VisionZip+SToPRetention=10%2026.04 | 79.72 | 3.34 | |
| VanillaRetention=100%2026.04 | 79.64 | — | |
| PruneVidRetention=15%2026.04 | 79.54 | 2.32 | |
| HolitomRetention=10%2026.04 | 79.48 | 3.21 | |
| FastVid+SToPRetention=10%2026.04 | 79.44 | 2.9 | |
| FastVidRetention=15%2026.04 | 79.24 | 3.15 | |
| VisionZipRetention=15%2026.04 | 79.1 | 3.23 | |
| PruneVidRetention=10%2026.04 | 79.1 | 3.17 | |
| FastVidRetention=10%2026.04 | 78.68 | 5.12 | |
| VisionZipRetention=10%2026.04 | 77.4 | 7.36 |