Video Question Answering on IntentQA (test)
79Top-1 AccuracyVideoMultiAgents
Evaluation results
| Method | Links | |
|---|---|---|
| VideoMultiAgentsSetting=Zero-shot2025.04 | 79 | |
| VideoINSTASetting=Zero-shot2025.04 | 72.8 | |
| LVNetSetting=Zero-shot2025.04 | 71.7 | |
| ENTERSetting=Zero-shot2025.04 | 71.5 | |
| VamosTraining Paradigm=Fine-tuned2024.05 | 68.5 | |
| TS-LLAVASetting=Zero-shot2025.04 | 67.9 | |
| LLoVi (GPT-4)Params=N/A, Zero-shot=true2024.12 | 67.1 | |
| VidCtxParams=7B, Zero-shot=true2024.12 | 67.1 | |
| LLoViSetting=Zero-shot2025.04 | 67.1 | |
| VideoTree (GPT-4)Params=N/A, Zero-shot=true2024.12 | 66.9 | |
| VideoTreeSetting=Zero-shot2025.04 | 66.9 | |
| VIDEOTREETraining Paradigm=Training-free, Evaluation Mode=Zero-shot2024.05 | 66.9 | |
| IG-VLMSetting=Zero-shot2025.04 | 65.3 | |
| IG-VLMTraining Paradigm=Training-free2024.05 | 64.2 | |
| LLoViTraining Paradigm=Training-free2024.05 | 64 | |
| Q-ViDParams=12B, Zero-shot=true2024.12 | 63.6 | |
| SeViLAParams=4B, Zero-shot=true, Pre-trained on video=true2024.12 | 60.9 | |
| SeViLASetting=Zero-shot2025.04 | 60.9 | |
| SeViLATraining Paradigm=Training-free2024.05 | 60.9 | |
| LangRepoParams=12B, Zero-shot=true2024.12 | 59.1 | |
| LangRepoTraining Paradigm=Training-free2024.05 | 59.1 | |
| VGTTraining Paradigm=Fine-tuned2024.05 | 51.3 |