List your company
ResearchFormerly WizWand

Audio-Visual Question Answering on Video-MME

75ScoreGemini 2.5 Pro
40.47249.43658.467.364Oct 14, 2025
Updated 7mo ago

Evaluation results

MethodLinks
Gemini 2.5 ProModel Category=Proprietary Models, QA Backbone=GPT-4o, Evaluation Approach=caption-to-QA cascade2025.1075
Gemini 2.5 FlashModel Category=Proprietary Models, QA Backbone=GPT-4o, Evaluation Approach=caption-to-QA cascade2025.1069.1
Omni-Captioner-7BModel Category=Open-Source Models, QA Backbone=GPT-4o, Evaluation Approach=caption-to-QA cascade2025.1067.1
video-SALMONN 2-7BModel Category=Open-Source Models, QA Backbone=GPT-4o, Evaluation Approach=caption-to-QA cascade2025.1065.9
Gemini 2.0 FlashModel Category=Proprietary Models, QA Backbone=GPT-4o, Evaluation Approach=caption-to-QA cascade2025.1064.4
Qwen2.5-Omni-7BModel Category=Open-Source Models, QA Backbone=GPT-4o, Evaluation Approach=caption-to-QA cascade2025.1052.7
VideoLLaMA 2-7BModel Category=Open-Source Models, QA Backbone=GPT-4o, Evaluation Approach=caption-to-QA cascade2025.1044.4
video-SALMONN-13BModel Category=Open-Source Models, QA Backbone=GPT-4o, Evaluation Approach=caption-to-QA cascade2025.1041.8