List your company
ResearchFormerly WizWand

Video Question Answering on VideoMME Medium

72.9AccuracyVideo Panels (GPT-4.1-2025-04-14)
24.5437.09549.6562.205Dec 24, 2024Feb 8, 2025Mar 26, 2025May 12, 2025Jun 27, 2025Aug 12, 2025Sep 28, 2025
Updated 6mo ago

Evaluation results

MethodLinks
Video Panels (GPT-4.1-2025-04-14)#frames=32, Model Context Category=Commercial VLMs2025.0972.9
GPT-4.1-2025-04-14#frames=32, Model Context Category=Commercial VLMs2025.0968.9
Video Panels (LLaVA-Video 72B)#frames=64, Model Context Category=Medium-context VLMs2025.0968.6
LLaVA-Video 72B#frames=64, Model Context Category=Medium-context VLMs2025.0967.8
Qwen-2.5VL 7B#frames=180, Model Context Category=Long-context VLMs2025.0967.6
Video Panels (Qwen-2.5VL 7B)#frames=180, Model Context Category=Long-context VLMs2025.0966.9
Video Panels (LLaVA-OV 72B)#frames=32, Model Context Category=Medium-context VLMs2025.0966.4
VideoLLaMA 3 7B#frames=180, Model Context Category=Long-context VLMs2025.0964.6
Video Panels (Qwen-2.5VL 7B)#frames=32, Model Context Category=Medium-context VLMs2025.0964
Video Panels (VideoLLaMA 3 7B)#frames=180, Model Context Category=Long-context VLMs2025.0963.7
LLaVA-OV 72B#frames=32, Model Context Category=Medium-context VLMs2025.0962.9
Video Panels (Qwen-2VL 7B)#frames=180, Model Context Category=Long-context VLMs2025.0962.9
Qwen-2VL 7B#frames=180, Model Context Category=Long-context VLMs2025.0962.7
LLaVA-Video 7B#frames=64, Model Context Category=Medium-context VLMs2025.0962.3
Video Panels (LLaVA-Video 7B)#frames=64, Model Context Category=Medium-context VLMs2025.0962.2
GPT-4O + VSLSSearching Modality=Unimodal, Frame=322025.0861.9
GPT-4O + VSISearching Modality=Multimodal, Frame=322025.0861.7
GPT-4O + TstarSearching Modality=Unimodal, Frame=322025.0861.6
Qwen-2.5VL 7B#frames=32, Model Context Category=Medium-context VLMs2025.0961.6
GPT-4OSearching Modality=N/A, Frame=82025.0861.2
GPT-4O + VSLSSearching Modality=Unimodal, Frame=82025.0861.1
GPT-4OSearching Modality=N/A, Frame=322025.0861
GPT-4O + TstarSearching Modality=Unimodal, Frame=82025.0859.7
GPT-4O + VSISearching Modality=Multimodal, Frame=82025.0859.5
LLaVA-OV 7B#frames=32, Model Context Category=Medium-context VLMs2025.0956.7
Video Panels (LLaVA-OV 7B)#frames=32, Model Context Category=Medium-context VLMs2025.0956.2
Video Panels (GPT-4o-mini-2025-04-14)#frames=8, Model Context Category=Commercial VLMs2025.0953
QWEN2.5-VL-7B-INSTRUCT+TstarSearching Modality=Unimodal, Frame=82025.0850
QWEN2.5-VL-7B-INSTRUCT+VSLSSearching Modality=Unimodal, Frame=322025.0850
GPT-4o-mini-2025-04-14#frames=8, Model Context Category=Commercial VLMs2025.0950
QWEN2.5-VL-7B-INSTRUCT+VSLSSearching Modality=Unimodal, Frame=82025.0849.6
QWEN2.5-VL-7B-INSTRUCT+VSISearching Modality=Multimodal, Frame=82025.0848.5
QWEN2.5-VL-7B-INSTRUCTSearching Modality=N/A, Frame=82025.0847.3
QWEN2.5-VL-7B-INSTRUCT+VSISearching Modality=Multimodal, Frame=322025.0845.8
QWEN2.5-VL-7B-INSTRUCT+TstarSearching Modality=Unimodal, Frame=322025.0845.6
Video Panels (LLaVA-OV 0.5B)#frames=32, Model Context Category=Medium-context VLMs2025.0942.6
LLaVA-Video-7B-Qwen2+VSISearching Modality=Multimodal, Frame=82025.0842.2
LLaVA-Video-7B-Qwen2+VSISearching Modality=Multimodal, Frame=322025.0842.2
LLaVA-OV 0.5B#frames=32, Model Context Category=Medium-context VLMs2025.0940.9
LLaVA-Video-7B-Qwen2+TstarSearching Modality=Unimodal, Frame=82025.0840.4
QWEN2.5-VL-7B-INSTRUCTSearching Modality=N/A, Frame=322025.0839.9
LLaVA-Video-7B-Qwen2Searching Modality=N/A, Frame=82025.0839.7
LLaVA-Video-7B-Qwen2+TstarSearching Modality=Unimodal, Frame=322025.0839.6
LLaVA-Video-7B-Qwen2+VSLSSearching Modality=Unimodal, Frame=322025.0839
LLaVA-Video-7B-Qwen2+VSLSSearching Modality=Unimodal, Frame=82025.0838.5
Video-LLaVAVision Size (M)=4252024.1238.1
Video-PandaVision Size (M)=452024.1237.9
Video Panels (Video-LLaVA 7B)#frames=8, Model Context Category=Small-context VLMs2025.0937.9
Video-LLaVA 7B#frames=8, Model Context Category=Small-context VLMs2025.0936.6
LLaVA-Video-7B-Qwen2Searching Modality=N/A, Frame=322025.0836.5
Video-ChatGPTVision Size (M)=3072024.1236
Video Panels (VideoChat2-HD)#frames=16, Model Context Category=Small-context VLMs2025.0926.7
VideoChat2-HD#frames=16, Model Context Category=Small-context VLMs2025.0926.4