Audio Understanding on MMAU audio
72.08Sound ScoreMiniCPM-O 2.6 + MoD-DPO
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MiniCPM-O 2.6 + MoD-DPObase_model=MiniCPM-O 2.6, method=MoD-DPO2026.03 | 72.08 | 70.08 | 64.78 | 68.98 | |
| MiniCPM-O 2.6 + MoD-DPO++base_model=MiniCPM-O 2.6, method=MoD-DPO++2026.03 | 71.34 | 69.23 | 64.91 | 68.3 | |
| MiniCPM-O 2.6 + OmniDPObase_model=MiniCPM-O 2.6, method=OmniDPO2026.03 | 70.65 | 69.15 | 63.38 | 67.73 | |
| MiniCPM-O 2.6 + DPObase_model=MiniCPM-O 2.6, method=DPO2026.03 | 69.38 | 67.13 | 64.23 | 66.91 | |
| MiniCPM-O 2.6base_model=MiniCPM-O 2.62026.03 | 69.23 | 66.76 | 64.26 | 66.75 | |
| Qwen 2.5 Omni + MoD-DPObase_model=Qwen 2.5 Omni, method=MoD-DPO2026.03 | 68.21 | 70.12 | 58.98 | 65.77 | |
| Qwen 2.5 Omni + MoD-DPO++base_model=Qwen 2.5 Omni, method=MoD-DPO++2026.03 | 68.16 | 71.6 | 59.24 | 66.33 | |
| Qwen 2.5 Omni + OmniDPObase_model=Qwen 2.5 Omni, method=OmniDPO2026.03 | 67.58 | 69.87 | 59.11 | 65.52 | |
| Qwen 2.5 Omni + DPObase_model=Qwen 2.5 Omni, method=DPO2026.03 | 67.23 | 69.99 | 58.34 | 65.19 | |
| Qwen 2.5 Omnibase_model=Qwen 2.5 Omni2026.03 | 66.19 | 68.34 | 59.32 | 64.62 | |
| Audio-InteractionSize=3B, Stream.=true, Multi-turn=true2026.06 | 65.63 | 57.93 | 46.68 | 58.15 | |
| Qwen2.5-OmniSize=7B, Stream.=false, Multi-turn=true2026.06 | 60.54 | 50.9 | 35.11 | 49.58 | |
| Baichuan-Omni-1.5Size=7B, Stream.=false, Multi-turn=true2026.06 | 57.53 | 36.53 | 24.82 | 40.4 | |
| Qwen2.5-OmniSize=3B, Stream.=false, Multi-turn=true2026.06 | 51.81 | 44.01 | 29.79 | 42.51 | |
| Voxtral-MiniSize=3B, Stream.=false, Multi-turn=true2026.06 | 46.08 | 34.13 | 30.5 | 37.24 | |
| Phi-4-multimodalSize=5.6B, Stream.=false, Multi-turn=true2026.06 | 44.65 | 27.84 | 21.99 | 31.75 | |
| Qwen2-AudioSize=7B, Stream.=false, Multi-turn=true2026.06 | 22.32 | 19.16 | 16.31 | 19.41 | |
| Audio-ReasonerSize=8.4B, Stream.=false, Multi-turn=false2026.06 | 20.48 | 26.65 | 13.48 | 20.57 | |
| Audio Flamingo 2Size=3B, Stream.=false, Multi-turn=false2026.06 | 1.5 | 1.49 | 0.35 | 1.16 |