Omnimodal Video-Audio Question Answering on IMAVB 1.0
75.4Std Dev Score (Video)OmniVinci
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| OmniVinciOption Order=Fixed2026.05 | 75.4 | 71.4 | 6.6 | 0 | 38.4 | |
| Uni-MoE-2.0-OmniOption Order=Fixed2026.05 | 74.8 | 69 | 9 | 0 | 38.2 | |
| OLAOption Order=Fixed2026.05 | 71 | 71.6 | 6.8 | 0 | 37.4 | |
| OmniVinciOption Order=Shuffled, K=32026.05 | 71 | 66.1 | 4.5 | 3.6 | 36.3 | |
| Uni-MoE-2.0-OmniOption Order=Shuffled, K=32026.05 | 71 | 67.8 | 4.9 | 3.3 | 36.8 | |
| OLAOption Order=Shuffled, K=32026.05 | 70.5 | 70.3 | 2.9 | 1.7 | 36.4 | |
| Video-SALMONN-2Option Order=Fixed2026.05 | 69.8 | 66.6 | 16.2 | 0 | 38.2 | |
| Baichuan-Omni-1.5Option Order=Fixed2026.05 | 66 | 66.8 | 13.8 | 0.6 | 36.8 | |
| Video-SALMONN-2Option Order=Shuffled, K=32026.05 | 64.5 | 59.1 | 11.1 | 15.9 | 37.7 | |
| Qwen2.5-OmniOption Order=Fixed2026.05 | 64.4 | 69 | 16 | 0.6 | 37.5 | |
| Baichuan-Omni-1.5Option Order=Shuffled, K=32026.05 | 61.5 | 62.6 | 9.3 | 9.3 | 35.7 | |
| Qwen2.5-OmniOption Order=Shuffled, K=32026.05 | 60.1 | 64.7 | 13.3 | 3.4 | 35.4 | |
| MiniCPM-o 2.6Option Order=Fixed2026.05 | 56.6 | 54.2 | 9 | 6.6 | 31.6 | |
| MiniCPM-o 2.6Option Order=Shuffled, K=32026.05 | 56.4 | 54 | 6.9 | 4.9 | 30.6 | |
| Qwen3-OmniOption Order=Shuffled, K=32026.05 | 52.6 | 58.9 | 43.5 | 30.5 | 46.4 | |
| Gemini 3.1 ProOption Order=Fixed, Proprietary=true2026.05 | 50.2 | 53.8 | 94 | 48.6 | 61.6 | |
| Gemini 3.1 ProOption Order=Shuffled, K=3, Proprietary=true2026.05 | 50 | 48 | 91.9 | 56.1 | 61.5 | |
| Qwen3-OmniOption Order=Fixed2026.05 | 40.6 | 46.6 | 72.8 | 23.6 | 45.9 |