Video Question Answering on Activity-Net
49.4AccuracyPaLI-X
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PaLI-XNumber of frames=162023.05 | 49.4 | — | |
| PaLI-XNumber of frames=82023.05 | 48.4 | — | |
| VisionTrimBase Model=Video-LLaVA-7B, Number of tokens=1362026.01 | 46 | — | |
| VINDLU2023.05 | 44.7 | — | |
| Uniform SamplingBase Model=Video-LLaVA-7B, Number of tokens=1362026.01 | 43.5 | — | |
| VanillaBase Model=Video-LLaVA-7B, Number of tokens=1362026.01 | 43.1 | — | |
| VanillaBase Model=Video-LLaVA-7B, Token Reduction Rate=0.0%2025.05 | 43.1 | — | |
| VisionZipBase Model=Video-LLaVA-7B, Token Reduction Rate=93.4%2025.05 | 43 | — | |
| MoB (with η-prior)Base Model=Video-LLaVA-7B, Token Reduction Rate=93.4%2025.05 | 42.8 | — | |
| SparseVLMBase Model=Video-LLaVA-7B, Token Reduction Rate=93.4%2025.05 | 42.6 | — | |
| TwigVLMBase Model=Video-LLaVA-7B, Token Reduction Rate=93.4%2025.05 | 41.5 | — | |
| FastVBase Model=Video-LLaVA-7B, Token Reduction Rate=93.4%2025.05 | 30.6 | — | |
| FrozenBiLM2024.04 | — | 43.2 | |
| JustAsk2024.04 | — | 38.9 | |
| MA-LMM2024.04 | — | 49.8 | |
| SINGULARITY2024.04 | — | 44.1 | |
| UMT-L2024.04 | — | 47.9 | |
| Video-LLaMA2024.04 | — | 45.5 | |
| VideoCoCa2024.04 | — | 56.1 |