Audio-Visual Question Answering on Daily-Omni
73.6ScoreGemini 2.5 Pro
Evaluation Results
| Method | Links | |
|---|---|---|
| Gemini 2.5 ProModel Category=Proprietary Models, QA Backbone=GPT-4o, Evaluation Approach=caption-to-QA cascade2025.10 | 73.6 | |
| Omni-Captioner-7BModel Category=Open-Source Models, QA Backbone=GPT-4o, Evaluation Approach=caption-to-QA cascade2025.10 | 67.9 | |
| Gemini 2.0 FlashModel Category=Proprietary Models, QA Backbone=GPT-4o, Evaluation Approach=caption-to-QA cascade2025.10 | 60.6 | |
| video-SALMONN 2-7BModel Category=Open-Source Models, QA Backbone=GPT-4o, Evaluation Approach=caption-to-QA cascade2025.10 | 59.7 | |
| Gemini 2.5 FlashModel Category=Proprietary Models, QA Backbone=GPT-4o, Evaluation Approach=caption-to-QA cascade2025.10 | 59.5 | |
| Qwen2.5-Omni-7BModel Category=Open-Source Models, QA Backbone=GPT-4o, Evaluation Approach=caption-to-QA cascade2025.10 | 47.9 | |
| video-SALMONN-13BModel Category=Open-Source Models, QA Backbone=GPT-4o, Evaluation Approach=caption-to-QA cascade2025.10 | 45 | |
| VideoLLaMA 2-7BModel Category=Open-Source Models, QA Backbone=GPT-4o, Evaluation Approach=caption-to-QA cascade2025.10 | 39.9 |