Video Question Answering on Video-MME w.o. sub. Medium
70.8AccuracyQwen2-VL + ReQuest
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen2-VL + ReQuestLLM Size=8B, #Frames=≤ 512, zero-shot transfer=true2026.07 | 70.8 | |
| Qwen2-VLLLM Size=8B, #Frames=512, reproduced=true2026.07 | 70.1 | |
| LLaVA-Video + ReQuestLLM Size=7B, #Frames=322026.07 | 64.1 | |
| NVILALLM Size=8B, #Frames=10242026.07 | 62.2 | |
| VideoTreeLLM Size=–, #Frames=–2026.07 | 59.9 | |
| LLaVA-VideoLLM Size=7B, #Frames=32, reproduced=true2026.07 | 59.3 | |
| LLaVa-OneVision + ReQuestLLM Size=7B, #Frames=32, zero-shot transfer=true2026.07 | 58.8 | |
| LongVULLM Size=7B, #Frames=1fps2026.07 | 58.2 | |
| LLaVa-OneVisionLLM Size=7B, #Frames=32, reproduced=true2026.07 | 56.6 | |
| Frame-VoyagerLLM Size=7B, #Frames=82026.07 | 56.3 | |
| LLoViLLM Size=–, #Frames=–2026.07 | 53.2 | |
| VideoLLaMA2LLM Size=7B, #Frames=162026.07 | 45.4 | |
| Chat-UniVi-V1.5LLM Size=7B, #Frames=642026.07 | 40.3 | |
| Video-LLaVALLM Size=7B, #Frames=82026.07 | 38 | |
| VideoChat2LLM Size=7B, #Frames=162026.07 | 37 | |
| ShareGPT4VideoLLM Size=8B, #Frames=162026.07 | 36.3 |