Audio Assessment Correlation on PAM
0.6987LCCSongEval-RM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SongEval-RM2026.02 | 0.6987 | 0.6977 | 0.4997 | |
| CMI-RMfine-tuned=true, training_variant=CMI-Pref2026.02 | 0.6932 | 0.6988 | 0.5101 | |
| CMI-RMfine-tuned=true, training_variant=CMI + MusicEval2026.02 | 0.6367 | 0.6606 | 0.4754 | |
| AnyAudio-Judge2026.06 | 0.614 | 0.601 | 0.435 | |
| Gemini3-pro2026.02 | 0.5972 | 0.5967 | 0.4283 | |
| PAM score2026.02 | 0.5873 | 0.6099 | 0.4367 | |
| AQAScoreModel=AF3-Think2026.01 | 0.582 | 0.587 | 0.419 | |
| AQAScoreModel=AF3-Think2026.06 | 0.582 | 0.587 | 0.419 | |
| AQAScoreModel=Qwen2.5-Omni-3B2026.01 | 0.54 | 0.56 | 0.41 | |
| AQAScoreModel=Qwen2.5-Omni-3B2026.06 | 0.54 | 0.56 | 0.41 | |
| audiobox-CE2026.02 | 0.5283 | 0.5204 | 0.3665 | |
| AQAScoreModel=Qwen2.5-Omni-7B2026.01 | 0.518 | 0.589 | 0.429 | |
| AQAScoreModel=Qwen2.5-Omni-7B2026.06 | 0.518 | 0.589 | 0.429 | |
| AQAScoreModel=AF32026.01 | 0.496 | 0.538 | 0.383 | |
| AQAScoreModel=AF32026.06 | 0.496 | 0.538 | 0.383 | |
| CascadeModel=AF32026.01 | 0.474 | 0.465 | 0.361 | |
| CLAPScoreModel=630k-best2026.01 | 0.472 | 0.477 | 0.337 | |
| CLAPScore2026.06 | 0.472 | 0.477 | 0.337 | |
| audiobox-CU2026.02 | 0.4645 | 0.4704 | 0.3279 | |
| audiobox-PQ2026.02 | 0.4636 | 0.4513 | 0.3166 | |
| CLAPScoreModel=Music+Speech2026.01 | 0.463 | 0.454 | 0.317 | |
| PromptingModel=Qwen2.5-Omni-7B2026.01 | 0.45 | 0.395 | 0.317 | |
| Gemini2.5-pro2026.02 | 0.4463 | 0.4355 | 0.3068 | |
| CLAPScoreModel=Music+AS2026.01 | 0.436 | 0.436 | 0.303 | |
| CMI-RMfine-tuned=false, training_variant=Distill only2026.02 | 0.4358 | 0.4304 | 0.2981 | |
| CLAPScoreModel=Music+Speech+AS2026.01 | 0.435 | 0.434 | 0.301 | |
| CascadeModel=Qwen2.5-Omni-7B2026.01 | 0.432 | 0.429 | 0.336 | |
| CascadeModel=Qwen2.5-Omni-3B2026.01 | 0.425 | 0.428 | 0.333 | |
| Qwen3-omni2026.02 | 0.4155 | 0.4113 | 0.3146 | |
| CascadeModel=AF3-Chat2026.01 | 0.41 | 0.41 | 0.319 | |
| PromptingModel=Qwen2.5-Omni-3B2026.01 | 0.408 | 0.367 | 0.296 | |
| CLAPScoreModel=630k-AS2026.01 | 0.384 | 0.377 | 0.261 | |
| Gemini2.5-flash2026.02 | 0.3813 | 0.3693 | 0.2571 | |
| AQAScoreModel=AF3-Chat2026.01 | 0.381 | 0.435 | 0.337 | |
| AQAScoreModel=AF3-Chat2026.06 | 0.381 | 0.435 | 0.337 | |
| PromptingModel=Gemini-2.5-Pro2026.01 | 0.33 | 0.293 | 0.232 | |
| PromptingModel=Gemini-2.5-Flash2026.01 | 0.286 | 0.231 | 0.187 | |
| Qwen2.5-omni2026.02 | 0.2776 | 0.2837 | 0.2144 | |
| audiobox-PC2026.02 | 0.2505 | 0.223 | 0.1552 | |
| PromptingModel=AF32026.01 | 0.235 | 0.21 | 0.172 | |
| PromptingModel=GPT-4-Audio2026.01 | 0.209 | 0.186 | 0.152 | |
| Qwen2-audio2026.02 | 0.1468 | 0.1523 | 0.112 | |
| PromptingModel=AF3-Think2026.01 | 0.053 | 0.053 | 0.044 | |
| PromptingModel=AF3-Chat2026.01 | 0.041 | 0.037 | 0.03 | |
| CascadeModel=AF3-Think2026.01 | 0.024 | 0.03 | 0.025 |