List your company

General Audio Understanding on MMSU 1.0 (test)

72.13Perception SemanticsQwen3-Omni
19.308433.021746.73560.4483Jan 30, 2026

Evaluation results

MethodLinks
Qwen3-OmniSize=30B-A3B2026.0172.1355.8338.8553.286.6482.1943.5878.8865.63
Qwen2.5-OmniSize=7B2026.0161.1143.9633.243.9782.476.7746.8775.2159.09
DIFFA-2Size=8B2026.0160.6339.0441.9245.5885.2977.5843.5876.460.45
GPT-4o-Audio2026.0159.741.5621.4439.6780.8378.7426.2571.9656.38
DIFFA-2Size=8B, Decoding Strategy=factor-based parallel decoding2026.0159.6939.5740.9345.0685.0277.2842.097660.1
Kimi-AudioSize=7B2026.0157.6442.335.7443.5281.7776.6555.2276.0359.28
Qwen-Audio-ChatSize=8B2026.0157.2138.5224.735.6958.6159.7825.655.9346.92
MiniCPM-OSize=8B2026.0156.5634.0536.4840.5480.7174.7246.7173.5756.53
DIFFASize=8B2026.0152.6736.6535.1240.2881.5372.6845.6772.9256.04
Qwen2-AudioSize=8B2026.0152.1432.8735.5639.0277.6264.8146.6768.953.27
Gemini 2.0 Flash2026.0147.1741.330.6240.8370.6970.6936.1647.8351.03
Baichuan-AudioSize=11B2026.0139.6331.2627.0931.4857.9663.9234.3555.743.09
Phi-4-multimodalSize=8B2026.0138.7234.8629.5633.4157.8165.9442.0957.5944.96
SalmonnSize=7B2026.0131.5529.0828.7129.8336.4326.2225.2630.0430.01
GLM-4-VoiceSize=9B2026.0127.824.5227.3426.1846.148.1644.3546.7635.51
LTUSize=7B2026.0121.3422.4618.7320.8122.6525.5324.7424.3722.61