Audio-Visual Joint Reasoning on OmniVideoBench
56.2Music ScoreGemini-3-Pro
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Gemini-3-ProModel Category=Closed-source2026.02 | 56.2 | 54.1 | 55.7 | 61 | 56.4 | 52.9 | 52.5 | 55.5 | |
| OmniVideo-R1Model Category=Open-source2026.02 | 40.7 | 38.1 | 46.6 | 53.8 | 43.5 | 43.9 | 41.4 | 44.8 | |
| Gemini-2.5-ProModel Category=Closed-source2026.02 | 38.5 | 57.7 | 61.7 | 57.8 | 64.4 | 55 | 55.9 | 58.9 | |
| Qwen3-Omni-30B-A3B-InstructModel Category=Open-source2026.02 | 30.8 | 35.8 | 38 | 46.8 | 37.4 | 37.7 | 29.7 | 37 | |
| Gemini-2.0-FlashModel Category=Closed-source2026.02 | 29.7 | 40.3 | 43.2 | 49.4 | 43.2 | 41.1 | 34.9 | 41.5 | |
| MiniCPM-o-7BModel Category=Open-source2026.02 | 27.5 | 28.6 | 30.2 | 31.4 | 28.5 | 34.5 | 26.2 | 29.7 | |
| VideoLLaMA2-7BModel Category=Open-source2026.02 | 26.4 | 30.7 | 29.3 | 32 | 28.2 | 29.6 | 28.3 | 29.2 | |
| Qwen3-Omni-30B-A3B-ThinkingModel Category=Open-source2026.02 | 26.4 | 37.2 | 38.5 | 46.8 | 35.6 | 35.5 | 35.2 | 37.2 | |
| Baichuan-Omni-1.5-7BModel Category=Open-source2026.02 | 24.2 | 31.3 | 31.4 | 28.9 | 31.8 | 28.4 | 32.4 | 30.7 | |
| Qwen2.5-Omni-7BModel Category=Open-source2026.02 | 23.1 | 25.3 | 30.7 | 41.6 | 27.4 | 25.3 | 26.7 | 29.3 | |
| HumanOmniV2-7BModel Category=Open-source2026.02 | 20.9 | 31.1 | 31.6 | 36.6 | 29.4 | 29.6 | 29.3 | 30.5 |