Video Question Answering on Video-MME Medium Duration 1.0
58.1Accuracy (No Subtitles)VILA-1.5
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| VILA-1.5LLM Size=34B2024.11 | 58.1 | 57.4 | |
| LLaVA-NeXT-VideoLLM Params=34B2024.11 | 50.1 | 52.2 | |
| LLaVA-NeXTLLM Size=34B, DPO tuning=true2024.11 | 50.1 | 52.2 | |
| Qwen-VL-Max2024.11 | 49.2 | 48.9 | |
| InternVL-V1.5LLM Params=20B2024.11 | 46.4 | 49.1 | |
| PPLLAVALLM Params=7B, Multi-image training=true2024.11 | 45.6 | 50.4 | |
| PPLLAVALLM Params=7B, Multi-image training=false2024.11 | 43.9 | 48.6 | |
| DynFocusInput=16 f, LLM Size=7B, Resolution=224x224, L=25, K/L=0.82024.11 | 43.7 | 46 | |
| Chat-UniVi-V1.5LLM Params=7B2024.11 | 40.3 | 44.6 | |
| LLaVA-NeXT-VideoLLM Params=7B2024.11 | 40.3 | 44.3 | |
| Chat-UniViLLM Size=7B2024.11 | 40.3 | 44.6 | |
| Qwen-VL-ChatLLM Params=7B2024.11 | 38.7 | 40.4 | |
| Video-LLaVALLM Params=7B2024.11 | 38 | 40.7 | |
| Video-LLaVAInput=8 f, LLM Size=7B2024.11 | 38 | 40.7 | |
| VideoChat2-MistralLLM Params=7B2024.11 | 37 | 39.4 | |
| VideoChat2Input=16 f, LLM Size=7B2024.11 | 37 | 39.4 | |
| ST-LLMLLM Params=7B2024.11 | 36.8 | 41.4 | |
| ST-LLMInput=16 f, LLM Size=7B2024.11 | 36.8 | 41.4 |