Audio Understanding on MMSU (test)
66.64Overall ScoreCovo-Audio
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Covo-AudioParam=7B2026.02 | 66.64 | 58.95 | 74.83 | |
| MiMo-Audio-7B-InstructThinking Mode=true2025.12 | 62.88 | 51.71 | 74.79 | |
| MiMo-Audio-7B-InstructThinking Mode=false2025.12 | 61.7 | 46.86 | 76.98 | |
| Audio Flamingo 32025.12 | 61.4 | — | — | |
| Audio Flamingo 3Param=7B2026.02 | 61.4 | — | — | |
| Gemini 1.5 Pro2025.12 | 60.7 | — | — | |
| Qwen2.5-OmniParam=7B2026.02 | 60.57 | 42.5 | 79.83 | |
| Kimi-Audio-Instruct2025.12 | 59.78 | 44.84 | 75.7 | |
| Kimi-AudioParam=7B2026.02 | 59.28 | 43.52 | 76.03 | |
| Qwen2.5-Omni2025.12 | 58.1 | 42.67 | 77.64 | |
| Step-Audio2-mini2025.12 | 57.18 | 42.71 | 72.6 | |
| GPT-4o AudioParam=-2026.02 | 56.38 | 39.67 | 71.96 | |
| Qwen2-Audio-InstructParam=8.4B2026.02 | 53.27 | 39.02 | 68.9 | |
| Gemini 2.0 FlashParam=-2026.02 | 51.03 | 40.83 | 47.83 | |
| GLM-4-Voice2025.12 | 13.3 | 11.04 | 16.16 |