Musicality Evaluation on MusicEval (test)
0.8266SRCCCMI-RM
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| CMI-RMfine-tuned=true, training_variant=CMI + MusicEval2026.02 | 0.8266 | 0.8195 | 0.6459 | |
| CMI-RMTrain Inputs=TLRA, Train Data=+110K pseudo, Encoder=MuQ-MuLan2026.06 | 0.8266 | — | — | |
| MuQ-Eval-A1Train Inputs=A, Train Data=2-axis MOS, Encoder=MuQ-large2026.06 | 0.8089 | — | — | |
| TuneJury, MuQ (T+A)Train Inputs=TA, Train Data=17K, Encoder=MuQ-MuLan2026.06 | 0.7848 | — | — | |
| CMI-RMfine-tuned=true, training_variant=CMI-Pref2026.02 | 0.7315 | 0.7272 | 0.5495 | |
| TuneJury, -SE (T+A)Train Inputs=TA, Train Data=15K, Encoder=CLAP+MERT2026.06 | 0.7154 | — | — | |
| TuneJury, -MA (T+A)Train Inputs=TA, Train Data=17K, Encoder=CLAP+MERT2026.06 | 0.71 | — | — | |
| SongEval-RM2026.02 | 0.6949 | 0.714 | 0.5185 | |
| SongEval-RMTrain Inputs=A, Train Data=5-axis MOS, Encoder=MuQ-large2026.06 | 0.6949 | — | — | |
| audiobox-CU2026.02 | 0.6764 | 0.6272 | 0.495 | |
| PAM scoreTrain Inputs=A, Mode=zero-shot, Encoder=MS-CLAP2026.06 | 0.6733 | — | — | |
| PAM score2026.02 | 0.6724 | 0.6466 | 0.4874 | |
| TuneJury (T+A)Train Inputs=TA, Train Data=17.5K, Encoder=CLAP+MERT2026.06 | 0.6687 | — | — | |
| TuneJury (A only)Train Inputs=TA, Train Data=17.5K, Encoder=CLAP+MERT, Inference Prompt=empty2026.06 | 0.6618 | — | — | |
| audiobox-CE2026.02 | 0.6599 | 0.6393 | 0.483 | |
| TuneJury, -MP (T+A)Train Inputs=TA, Train Data=15.5K, Encoder=CLAP+MERT2026.06 | 0.6539 | — | — | |
| audiobox-PQ2026.02 | 0.6335 | 0.6016 | 0.462 | |
| Audiobox-AestheticsTrain Inputs=A, Train Data=4-axis MOS2026.06 | 0.624 | — | — | |
| Gemini3-pro2026.02 | 0.6018 | 0.6044 | 0.44 | |
| CMI-RMfine-tuned=false, training_variant=Distill only2026.02 | 0.5117 | 0.5253 | 0.3711 | |
| Gemini2.5-pro2026.02 | 0.4902 | 0.4966 | 0.3454 | |
| Gemini2.5-flash2026.02 | 0.3886 | 0.4188 | 0.2694 | |
| Qwen3-omni2026.02 | 0.3101 | 0.3693 | 0.2205 | |
| Qwen2-audio2026.02 | 0.2196 | 0.1455 | 0.1585 | |
| Qwen2.5-omni2026.02 | 0.1454 | 0.1655 | 0.1145 | |
| audiobox-PC2026.02 | 0.0768 | 0.1225 | 0.0514 |