Video Question Answering on TVQA
82.2AccuracyLLaMA-VQA
Evaluation Results
| Method | Links | |
|---|---|---|
| LLaMA-VQALanguage Model=LLaMA, Number of Trainable Parameters=4.5M2023.10 | 82.2 | |
| FrozenBiLM#PT=400M2022.12 | 82 | |
| FrozenBiLMNumber of Frames=10, Speech Input=true2023.05 | 82 | |
| VINDLU#PT=5M2022.12 | 79 | |
| VINDLU#PT=25M2022.12 | 79 | |
| VINDLU#PT=17M2022.12 | 78.8 | |
| MERLOT#PT=180M2022.12 | 78.7 | |
| MERLOTLanguage Model=ROBERTa, Number of Trainable Parameters=223M2023.10 | 78.7 | |
| SPCRLLanguage Model=BERT2023.10 | 76.2 | |
| VidLLanguage Model=BERT, Number of Trainable Parameters=25M2023.10 | 76 | |
| HERO#PT=7.5M2022.12 | 74.2 | |
| HEROInput=dense/1fps, Speech Input=true2023.05 | 73.6 | |
| ViLAFrames Numbers=42023.12 | 63.4 | |
| SEVILANumber of Frames=32 -> 4, Keyframe Selection=refined LOCALIZER2023.05 | 61.6 | |
| SeViLAFrames Numbers=42023.12 | 61.6 | |
| ViLAFrames Numbers=22023.12 | 60.6 | |
| BLIP-2 concat (ANSWERER)Number of Frames=4, Protocol=feature concatenation2023.05 | 59.8 | |
| SEVILA†Number of Frames=32 -> 4, Keyframe Selection=zero-shot LOCALIZER2023.05 | 59.7 | |
| FrozenBiLMNumber of Frames=10, speech input or dense frames=true, Zero-shot=true2023.05 | 59.2 | |
| FrozenBiLMNumber of Frames=102023.05 | 57.5 | |
| FrozenBiLMFrames Numbers=102023.12 | 57.5 | |
| HiTeA2023.10 | 57.2 | |
| InternVideoNumber of Frames=8, Tested_by_authors=true2023.05 | 57.2 | |
| InternVideoFrames Numbers=82023.12 | 57.2 | |
| BLIP-2 votingNumber of Frames=4, Protocol=majority voting2023.05 | 54.5 | |
| BLIP-2Frames Numbers=42023.12 | 54.5 | |
| HGALanguage Model=GRU2023.10 | 50.1 | |
| Q-ViDevaluation_mode=Zero-shot2024.02 | 41 | |
| VideoChat2evaluation_mode=Zero-shot2024.02 | 40.6 | |
| HCRNLanguage Model=LSTM, Number of Trainable Parameters=44M2023.10 | 38.2 | |
| SeViLA†Number of Frames=32 -> 4, Zero-shot=true2023.05 | 38.2 | |
| SeViLaevaluation_mode=Zero-shot2024.02 | 38.2 | |
| BLIP-2concat (Answerer)Number of Frames=4, Zero-shot=true2023.05 | 36.6 | |
| BLIP-2concatevaluation_mode=Zero-shot2024.02 | 36.6 | |
| InternVideo*Number of Frames=8, Zero-shot=true2023.05 | 35.9 | |
| InternVideoevaluation_mode=Zero-shot2024.02 | 35.9 | |
| BLIP-2votingNumber of Frames=4, Zero-shot=true2023.05 | 35.7 | |
| BLIP-2votingevaluation_mode=Zero-shot2024.02 | 35.7 | |
| FrozenBiLMNumber of Frames=10, Zero-shot=true2023.05 | 29.7 | |
| FrozenBILMevaluation_mode=Zero-shot2024.02 | 29.7 |