Video-driven Audio Hallucination on AVHBench
83.4AccuracyQwen 2.5 Omni + MoD-DPO++
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Qwen 2.5 Omni + MoD-DPO++Reference Model=Qwen 2.5 Omni, Optimization Method=MoD-DPO++2026.03 | 83.4 | 93.82 | 72.98 | 82.1 | — | — | |
| Qwen 2.5 Omni + MoD-DPOReference Model=Qwen 2.5 Omni, Optimization Method=MoD-DPO2026.03 | 82.48 | 93.61 | 71.35 | 80.98 | — | — | |
| Qwen 2.5 Omni + OmniDPOReference Model=Qwen 2.5 Omni, Optimization Method=OmniDPO2026.03 | 80.77 | 86.36 | 75.19 | 80.39 | — | — | |
| ACPO2026.04 | 79.9 | 78.2 | 82.8 | 80.4 | 79.2 | 78.8 | |
| Qwen 2.5 Omni + DPOReference Model=Qwen 2.5 Omni, Optimization Method=DPO2026.03 | 79.68 | 93.53 | 65.85 | 77.28 | — | — | |
| MiniCPM-O 2.6 + MoD-DPO++Reference Model=MiniCPM-O 2.6, Optimization Method=MoD-DPO++2026.03 | 79.49 | 82.39 | 76.58 | 79.38 | — | — | |
| MiniCPM-O 2.6 + MoD-DPOReference Model=MiniCPM-O 2.6, Optimization Method=MoD-DPO2026.03 | 79 | 82.18 | 75.81 | 78.87 | — | — | |
| MiniCPM-O 2.6 + DPOReference Model=MiniCPM-O 2.6, Optimization Method=DPO2026.03 | 78.86 | 82.82 | 68.89 | 75.22 | — | — | |
| OmniDPO2026.04 | 78.7 | 79.3 | 77.5 | 78.4 | — | — | |
| OmniDPO2026.04 | 78.4 | 76.6 | 81.6 | 79 | 78.7 | 78.6 | |
| SFT2026.04 | 77.9 | 76.2 | 81 | 78.5 | — | — | |
| ACPO2026.04 | 77.7 | 76.9 | 79.1 | 78 | — | — | |
| DPO2026.04 | 77.5 | 75.3 | 81.6 | 78.3 | — | — | |
| Qwen 2.5 OmniReference Model=Qwen 2.5 Omni2026.03 | 77.38 | 94.93 | 59.83 | 73.39 | — | — | |
| Base model2026.04 | 77.2 | 75.4 | 80.6 | 78 | — | — | |
| Qwen 3 OmniReference Model=Qwen 3 Omni2026.03 | 76.46 | 94.94 | 57.99 | 72 | — | — | |
| SFT2026.04 | 76.2 | 72.8 | 83.5 | 77.8 | 78.1 | 77 | |
| DPO2026.04 | 76 | 70.6 | 88.9 | 78.7 | 78.5 | 76.7 | |
| MiniCPM-O 2.6 + OmniDPOReference Model=MiniCPM-O 2.6, Optimization Method=OmniDPO2026.03 | 75.39 | 80.56 | 70.22 | 75.04 | — | — | |
| VideoLLaMA 2Reference Model=VideoLLaMA 22026.03 | 75.07 | 85.15 | 64.98 | 73.71 | — | — | |
| MiniCPM-O 2.6Reference Model=MiniCPM-O 2.62026.03 | 74.54 | 82.27 | 66.81 | 73.74 | — | — | |
| Base model2026.04 | 74 | 68.6 | 88.5 | 77.3 | 77.6 | 75.6 | |
| MiniCPM-oreported_in_cited_work=true2026.04 | 72.8 | 70.4 | 78.6 | 74.4 | 75.1 | 73.7 | |
| Qwen2.5-Omnireported_in_cited_work=true2026.04 | 67.6 | 60.8 | 98.8 | 75.3 | 76.4 | 70.9 | |
| Gemini-Flash-1.5reported_in_cited_work=true2026.04 | 63 | 57.9 | 94.7 | 71.9 | 77.8 | 73.2 | |
| OmniVinciReference Model=OmniVinci2026.03 | 58.56 | 84.71 | 32.4 | 46.88 | — | — | |
| VITA-1.5Reference Model=VITA-1.52026.03 | 54.01 | 45.85 | 62.18 | 52.78 | — | — |