Cross-modal Hallucination Detection on Curse of Multi-Modalities (CMM) 1.0 (test) benchmark leaderboard · SOTA2 Research

Cross-modal Hallucination Detection on Curse of Multi-Modalities (CMM) 1.0 (test)

96.5VL Precision (pa)Qwen 3 Omni

Evaluation Results

Method	Links
Qwen 3 Omni2026.03		96.5	77.5	93	88	97.5	94	95.5	60	94.5	67	93	65	95	75.3
VITA 1.52026.03		92.5	91.5	42.5	30.5	77.7	72.9	57	24.4	77.4	67.7	86	55.5	72.2	57.1
Qwen 2.5 Omni + MoD-DPO++2026.03		92.5	98.5	92.7	85.8	94.5	95.5	91.3	75.1	89.1	84.3	74.9	83.8	89.2	87.2
Qwen 2.5 Omni + MoD-DPO2026.03		91.5	98.5	92.3	83.2	94.5	94.5	92.3	74.2	88.4	83.8	73.9	83.1	88.8	86.2
MiniCPM-O 2.6 + MoD-DPO2026.03		90.5	95.5	92	76	91.5	86	82.5	84.8	89	78.9	82.4	73.7	88	82.5
MiniCPM-O 2.6 + MoD-DPO++2026.03		90	96.5	92.5	77.5	91.5	87	83.5	85.6	88.4	79.6	83.8	75.1	88.3	83.6
Qwen 2.5 Omni + OmniDPO2026.03		89	98	89.5	83.5	94	93	88.8	69.9	86.1	81.3	72.2	82.6	86.6	84.7
OmniVinci2026.03		88.5	81	74.5	90	98	72	91	63.5	96	35	87	75	89.2	69.4
Qwen 2.5 Omni2026.03		88	98	89.9	84.4	93	93.5	87.8	67.7	85.3	80.7	74.2	83.2	86.4	84.6
MiniCPM-O 2.6 + OmniDPO2026.03		88	95	91	76.5	88.5	84	79.1	78.8	88.4	77.8	83.2	71.6	86.4	80.6
MiniCPM-O 2.62026.03		87	94	90.5	74	87	84	79.5	80.5	87.4	76.4	82	73.7	85.6	80.4
MiniCPM-O 2.6 + DPO2026.03		87	93	89.5	74.5	86	84.5	79.5	79.5	87.8	76	81.5	74.3	85.2	80.3
Qwen 2.5 Omni + DPO2026.03		86	98.5	89.5	86.5	92.4	94.4	86.7	63.5	84.3	80.4	72.5	84.1	85.2	84.6
VideoLLaMA 22026.03		75	86	77.5	94	78	98	62	75.5	80	90	57.5	43	71.7	81.1