Video Question Answering on Video-MME Short Duration 1.0
68.1Accuracy (w/o subtitles)VILA-1.5
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| VILA-1.5LLM Size=34B2024.11 | 68.1 | 68.9 | — | |
| LLaVA-NeXT-VideoLLM Params=34B2024.11 | 61.7 | 65.1 | — | |
| LLaVA-NeXTLLM Size=34B, DPO tuning=true2024.11 | 61.7 | 65.1 | — | |
| InternVL-V1.5LLM Params=20B2024.11 | 60.2 | 61.7 | — | |
| PPLLAVALLM Params=7B, Multi-image training=true2024.11 | 58.7 | 62.8 | — | |
| PPLLAVALLM Params=7B, Multi-image training=false2024.11 | 56.1 | 59.7 | — | |
| Qwen-VL-Max2024.11 | 55.8 | 57.6 | — | |
| DynFocusInput=16 f, LLM Size=7B, Resolution=224x224, L=25, K/L=0.82024.11 | 50.9 | 53.7 | — | |
| VideoChat2-MistralLLM Params=7B2024.11 | 48.3 | 52.8 | — | |
| VideoChat2Input=16 f, LLM Size=7B2024.11 | 48.3 | 52.8 | — | |
| Qwen-VL-ChatLLM Params=7B2024.11 | 46.9 | 47.3 | — | |
| LLaVA-NeXT-VideoLLM Params=7B2024.11 | 45.9 | 49.8 | — | |
| ST-LLMLLM Params=7B2024.11 | 45.7 | 48.4 | — | |
| Chat-UniVi-V1.5LLM Params=7B2024.11 | 45.7 | 51.2 | — | |
| ST-LLMInput=16 f, LLM Size=7B2024.11 | 45.7 | 48.4 | — | |
| Chat-UniViLLM Size=7B2024.11 | 45.7 | 51.2 | — | |
| Video-LLaVALLM Params=7B2024.11 | 45.3 | 46.1 | — | |
| Video-LLaVAInput=8 f, LLM Size=7B2024.11 | 45.3 | 46.1 | — | |
| +HACLsubtitles=with2025.12 | — | — | 73.1 | |
| +HACLsubtitles=without2025.12 | — | — | 69.9 | |
| +SANTAsubtitles=with2025.12 | — | — | 76.8 | |
| +SANTAsubtitles=without2025.12 | — | — | 72.3 | |
| +SFTsubtitles=with2025.12 | — | — | 54.8 | |
| +SFTsubtitles=without2025.12 | — | — | 56.8 | |
| EgoAVU (Full)Fine-tuning Strategy=Full2026.02 | — | — | 72 | |
| EgoAVU (LoRA)Fine-tuning Strategy=LoRA2026.02 | — | — | 72.4 | |
| LLaVA-Videosubtitles=with2025.12 | — | — | 80.1 | |
| LLaVA-Videosubtitles=without2025.12 | — | — | 77 | |
| Qwen2.5-Omni2026.02 | — | — | 73 |