Music Understanding on MusicBench Temporal
75Chords ScoreGaMMA-14B
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| GaMMA-14Bnumber of parameters=14B2026.05 | 75 | 86.5 | 95.5 | 70 | 68.9 | 79.3 | |
| GaMMA-8Bnumber of parameters=8B2026.05 | 60 | 92 | 90.5 | 82.4 | 55.8 | 76.2 | |
| Gemini-3.0 Pro2026.05 | 53 | 88 | 89.5 | 74.5 | 70.4 | 75.2 | |
| Gemini-2.5 Pro2026.05 | 46.5 | 91.5 | 97 | 69.2 | 64.8 | 74.6 | |
| Audio-Flamingo3number of parameters=8B2026.05 | 46 | 57 | 35 | 49.8 | 44.7 | 46.5 | |
| Qwen2.5-Omninumber of parameters=8B2026.05 | 45 | 57 | 86 | 78.4 | 61.3 | 65.5 | |
| Qwen2Audionumber of parameters=7B2026.05 | 28.5 | 38 | 57 | 50.3 | 32.2 | 41.2 | |
| Kimi-Audionumber of parameters=8B2026.05 | 27.5 | 49.5 | 75 | 61.8 | 37.2 | 50.3 | |
| Flamingo 22026.05 | 27 | 32.5 | 15.5 | 26.6 | 35.7 | 27.5 | |
| QwenAudionumber of parameters=7B2026.05 | 25 | 35 | 29.5 | 51.8 | 33.2 | 34.9 | |
| Mu-LLaMAnumber of parameters=7B2026.05 | 15.5 | 28 | 3.5 | 29.2 | 34.2 | 22 |