Video Question Answering on Perception (test)
75.6Test AccuracyVideoChat-Flash
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| VideoChat-FlashSize=7B, #Tokens=162025.01 | 75.6 | — | — | — | — | |
| InternVideo2.5 (InternVL2.5+LRC)Size=7B, #Tokens=162025.01 | 74.9 | — | — | — | — | |
| Qwen2.5-VL-7B+TIR-FlowFrames=322026.01 | 73.2 | — | — | — | — | |
| VideoLLaMA3-7BFrames=1802026.01 | 72.8 | — | — | — | — | |
| LLaVA-Video-7B+TIR-FlowFrames=322026.01 | 71.5 | — | — | — | — | |
| Qwen2.5-VL-7BFrames=322026.01 | 69.1 | — | — | — | — | |
| BIMBA-LLaVALLM=Qwen2-7B, Frames=1282025.03 | 68.51 | — | — | — | — | |
| InternVL2.5Size=7B, #Tokens=2562025.01 | 68.2 | — | — | — | — | |
| QwenVL2Size=72B2025.01 | 68 | — | — | — | — | |
| LLaVA-VideoLLM=Qwen2-7B, Frames=642025.03 | 67.9 | — | — | — | — | |
| LLaVA-Video-7BFrames=322026.01 | 67.9 | — | — | — | — | |
| LLaVA-OneVisionSize=72B, #Tokens=1962025.01 | 66.9 | — | — | — | — | |
| Qwen2-VL-7B-InstructFrames=322026.01 | 63.7 | — | — | — | — | |
| InternVideo2-HDSize=7B, #Tokens=722025.01 | 63.4 | — | — | — | — | |
| QwenVL2Size=7B2025.01 | 62.3 | — | — | — | — | |
| Qwen2 VL (7B)# Frames=2 fps (max 768)2024.10 | 62.3 | — | — | — | — | |
| VideoLLaMA2Size=72B, #Tokens=722025.01 | 57.5 | — | — | — | — | |
| LLaVA-OneVisionSize=7B, #Tokens=1962025.01 | 57.1 | — | — | — | — | |
| LLaVA-OneVisionLLM=Qwen2-7B, Frames=322025.03 | 57.1 | — | — | — | — | |
| Baichuan-omni (7B)# Frames=1 fps (max 48)2024.10 | 56.8 | — | — | — | — | |
| BIMBA-LLAMALLM=LLaMA3.2-8B, Frames=642025.03 | 56.5 | — | — | — | — | |
| VITA (8x7B)# Frames=1 fps (max 32)2024.10 | 56.2 | — | — | — | — | |
| VideoChat-TPOSize=7B, #Tokens=642025.01 | 54.7 | — | — | — | — | |
| VILA-40BFrames=2562026.01 | 54 | — | — | — | — | |
| LLaMA-3.2 (Video)LLM=LLaMA3.2-8B, Frames=642025.03 | 53.16 | — | — | — | — | |
| PLLAVA (LLaMA-3.2)LLM=LLaMA3.2-8B, Frames=642025.03 | 53.13 | — | — | — | — | |
| BIMBA-LLaVALLM=Vicuna-7B, Frames=642025.03 | 52.61 | — | — | — | — | |
| VideoLLaMA2Size=7B, #Tokens=722025.01 | 51.4 | — | — | — | — | |
| VideoLLaMA 2 (7B)# Frames=162024.10 | 51.4 | — | — | — | — | |
| Video-LLaMA2LLM=Qwen2-7B, Frames=322025.03 | 51.4 | — | — | — | — | |
| TraveLERTraining Protocol=Zero-shot2024.04 | 50.2 | — | — | — | — | |
| LLaVA-NeXT-VideoSize=7B, #Tokens=1442025.01 | 48.8 | — | — | — | — | |
| LLaVA-NeXT-Video (7B)# Frames=322024.10 | 48.8 | — | — | — | — | |
| LLaVA-NeXT-VideoLLM=Vicuna-7B, Frames=322025.03 | 48.8 | — | — | — | — | |
| PLLAVALLM=Vicuna-7B, Frames=642025.03 | 48.55 | — | — | — | — | |
| MC-ViT-LTraining Protocol=Uses fine-tuned components2024.04 | 48.1 | — | — | — | — | |
| VideoChat2 (7B)# Frames=162024.10 | 47.3 | — | — | — | — | |
| VideoChat2LLM=Vicuna-7B, Frames=162025.03 | 47.3 | — | — | — | — | |
| MC-ViT-BTraining Protocol=Uses fine-tuned components2024.04 | 47 | — | — | — | — | |
| SeViLATraining Protocol=Uses fine-tuned components2024.04 | 46.2 | — | — | — | — | |
| LLaVA-NeXT (Video)LLM=Vicuna-7B, Frames=642025.03 | 46.13 | — | — | — | — | |
| Long ViViTTraining Protocol=Zero-shot2024.04 | 45.7 | — | — | — | — | |
| BOLDModel=SeViLA, k=0.52024.10 | 45.32 | 45.18 | 5.18 | 2.95 | 1.3 | |
| Weighted_BOLDModel=SeViLA, k=0.52024.10 | 45.31 | 45.2 | 4.56 | 2.83 | 1.08 | |
| LLaMA-VIDSize=7B, #Tokens=22025.01 | 44.6 | — | — | — | — | |
| LLAMA-VIDLLM=Vicuna-7B, Frames=1fps2025.03 | 44.6 | — | — | — | — | |
| Video-LLaVA (7B)# Frames=82024.10 | 44.3 | — | — | — | — | |
| Video-LLaVALLM=Vicuna-7B, Frames=82025.03 | 44.3 | — | — | — | — | |
| Flamingo-3BTraining Protocol=Zero-shot2024.04 | 43.6 | — | — | — | — | |
| Weighted_BOLDModel=Video-LLaMA, k=0.52024.10 | 42.06 | 39.36 | 21.8 | 9.11 | 13.02 | |
| Weighted_BOLDModel=Video-LLaVA, k=0.52024.10 | 41.95 | 39.46 | 19.73 | 10.24 | 3.4 | |
| BOLDModel=Video-LLaMA, k=0.52024.10 | 41.9 | 38.68 | 24.05 | 9.87 | 14.45 | |
| BOLDModel=Video-LLaVA, k=0.52024.10 | 41.62 | 38.69 | 21.75 | 10.92 | 3.78 | |
| AnyGPT (8B)# Frames=482024.10 | 29.1 | — | — | — | — | |
| V-JEPA 2Params Enc / LLM=1B/8B, Evaluation Protocol=SFT2025.06 | 0.84 | — | — | — | — | |
| PLM 8BParams Enc / LLM=1B/8B, Evaluation Protocol=zero-shot2025.06 | 0.827 | — | — | — | — | |
| Qwen2.5VLParams Enc / LLM=1B/7B, Evaluation Protocol=zero-shot2025.06 | 0.705 | — | — | — | — | |
| InternVL-2.5Params Enc / LLM=300M/7B, Evaluation Protocol=zero-shot2025.06 | 0.689 | — | — | — | — | |
| Qwen2VLParams Enc / LLM=675M/7B, Evaluation Protocol=zero-shot2025.06 | 0.669 | — | — | — | — |