Cross-modal Hallucination Detection on Curse of Multi-Modalities (CMM) 1.0 (test)
96.5VL Precision (pa)Qwen 3 Omni
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen 3 Omni2026.03 | 96.5 | 77.5 | 93 | 88 | 97.5 | 94 | 95.5 | 60 | 94.5 | 67 | 93 | 65 | 95 | 75.3 | |
| VITA 1.52026.03 | 92.5 | 91.5 | 42.5 | 30.5 | 77.7 | 72.9 | 57 | 24.4 | 77.4 | 67.7 | 86 | 55.5 | 72.2 | 57.1 | |
| Qwen 2.5 Omni + MoD-DPO++base_model=Qwen 2.5 Omni, alignment_method=MoD-DPO++2026.03 | 92.5 | 98.5 | 92.7 | 85.8 | 94.5 | 95.5 | 91.3 | 75.1 | 89.1 | 84.3 | 74.9 | 83.8 | 89.2 | 87.2 | |
| Qwen 2.5 Omni + MoD-DPObase_model=Qwen 2.5 Omni, alignment_method=MoD-DPO2026.03 | 91.5 | 98.5 | 92.3 | 83.2 | 94.5 | 94.5 | 92.3 | 74.2 | 88.4 | 83.8 | 73.9 | 83.1 | 88.8 | 86.2 | |
| MiniCPM-O 2.6 + MoD-DPObase_model=MiniCPM-O 2.6, alignment_method=MoD-DPO2026.03 | 90.5 | 95.5 | 92 | 76 | 91.5 | 86 | 82.5 | 84.8 | 89 | 78.9 | 82.4 | 73.7 | 88 | 82.5 | |
| MiniCPM-O 2.6 + MoD-DPO++base_model=MiniCPM-O 2.6, alignment_method=MoD-DPO++2026.03 | 90 | 96.5 | 92.5 | 77.5 | 91.5 | 87 | 83.5 | 85.6 | 88.4 | 79.6 | 83.8 | 75.1 | 88.3 | 83.6 | |
| Qwen 2.5 Omni + OmniDPObase_model=Qwen 2.5 Omni, alignment_method=OmniDPO2026.03 | 89 | 98 | 89.5 | 83.5 | 94 | 93 | 88.8 | 69.9 | 86.1 | 81.3 | 72.2 | 82.6 | 86.6 | 84.7 | |
| OmniVinci2026.03 | 88.5 | 81 | 74.5 | 90 | 98 | 72 | 91 | 63.5 | 96 | 35 | 87 | 75 | 89.2 | 69.4 | |
| Qwen 2.5 Omni2026.03 | 88 | 98 | 89.9 | 84.4 | 93 | 93.5 | 87.8 | 67.7 | 85.3 | 80.7 | 74.2 | 83.2 | 86.4 | 84.6 | |
| MiniCPM-O 2.6 + OmniDPObase_model=MiniCPM-O 2.6, alignment_method=OmniDPO2026.03 | 88 | 95 | 91 | 76.5 | 88.5 | 84 | 79.1 | 78.8 | 88.4 | 77.8 | 83.2 | 71.6 | 86.4 | 80.6 | |
| MiniCPM-O 2.62026.03 | 87 | 94 | 90.5 | 74 | 87 | 84 | 79.5 | 80.5 | 87.4 | 76.4 | 82 | 73.7 | 85.6 | 80.4 | |
| MiniCPM-O 2.6 + DPObase_model=MiniCPM-O 2.6, alignment_method=DPO2026.03 | 87 | 93 | 89.5 | 74.5 | 86 | 84.5 | 79.5 | 79.5 | 87.8 | 76 | 81.5 | 74.3 | 85.2 | 80.3 | |
| Qwen 2.5 Omni + DPObase_model=Qwen 2.5 Omni, alignment_method=DPO2026.03 | 86 | 98.5 | 89.5 | 86.5 | 92.4 | 94.4 | 86.7 | 63.5 | 84.3 | 80.4 | 72.5 | 84.1 | 85.2 | 84.6 | |
| VideoLLaMA 22026.03 | 75 | 86 | 77.5 | 94 | 78 | 98 | 62 | 75.5 | 80 | 90 | 57.5 | 43 | 71.7 | 81.1 |