Open-Ended Audio-Video QA on AVSD
57.2AccuracyVideoLLaMA2-AV
Evaluation results
| Method | Links | |
|---|---|---|
| VideoLLaMA2-AVNumber of Parameters=7B, # Pairs=1.9M2024.06 | 57.2 | |
| VideoLLaMA2.1-AVNumber of Parameters=7B, # Pairs=2.0M2024.06 | 57.2 | |
| AVicunaNumber of Parameters=7B, # Pairs=1.1M, Evaluation Protocol=Zero-shot2024.06 | 53.1 | |
| AV-LLMNumber of Parameters=13B, # Pairs=1.6M, Evaluation Protocol=Zero-shot2024.06 | 52.6 | |
| VideoLLaMANumber of Parameters=7B, # Pairs=2.8M, Evaluation Protocol=Zero-shot2024.06 | 36.7 | |
| Macaw-LLMNumber of Parameters=7B, # Pairs=0.3M, Evaluation Protocol=Zero-shot2024.06 | 34.3 | |
| PandaGPTNumber of Parameters=13B, # Pairs=128M, Evaluation Protocol=Zero-shot2024.06 | 26.1 |