Audio Assessment Correlation on RELATE
0.544LCCAQAScore
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AQAScoreModel=Qwen2.5-Omni-7B2026.01 | 0.544 | 0.556 | 0.396 | |
| AQAScoreModel=AF32026.01 | 0.475 | 0.508 | 0.357 | |
| CLAPScoreModel=630k-best2026.01 | 0.448 | 0.432 | 0.291 | |
| AQAScoreModel=Qwen2.5-Omni-3B2026.01 | 0.443 | 0.453 | 0.327 | |
| CLAPScoreModel=630k-AS2026.01 | 0.442 | 0.42 | 0.289 | |
| AQAScoreModel=AF3-Think2026.01 | 0.435 | 0.474 | 0.33 | |
| PromptingModel=Qwen2.5-Omni-7B2026.01 | 0.435 | 0.397 | 0.322 | |
| CascadeModel=Qwen2.5-Omni-7B2026.01 | 0.405 | 0.409 | 0.319 | |
| PromptingModel=Gemini-2.5-Pro2026.01 | 0.397 | 0.388 | 0.309 | |
| CLAPScoreModel=Music+Speech2026.01 | 0.395 | 0.351 | 0.241 | |
| RELATE2026.01 | 0.385 | 0.383 | 0.265 | |
| CLAPScoreModel=Music+AS2026.01 | 0.379 | 0.364 | 0.248 | |
| RELATE w/ CBL2026.01 | 0.377 | 0.374 | 0.259 | |
| CLAPScoreModel=Music+Speech+AS2026.01 | 0.369 | 0.355 | 0.244 | |
| CascadeModel=Qwen2.5-Omni-3B2026.01 | 0.369 | 0.373 | 0.288 | |
| PromptingModel=AF32026.01 | 0.368 | 0.361 | 0.296 | |
| PromptingModel=Gemini-2.5-Flash2026.01 | 0.331 | 0.302 | 0.242 | |
| AQAScoreModel=AF3-Chat2026.01 | 0.3 | 0.389 | 0.271 | |
| PromptingModel=GPT-4-Audio2026.01 | 0.3 | 0.347 | 0.279 | |
| PromptingModel=Qwen2.5-Omni-3B2026.01 | 0.29 | 0.26 | 0.215 | |
| CascadeModel=AF32026.01 | 0.285 | 0.296 | 0.228 | |
| CascadeModel=AF3-Chat2026.01 | 0.24 | 0.236 | 0.184 | |
| CascadeModel=AF3-Think2026.01 | 0.168 | 0.169 | 0.132 | |
| PromptingModel=AF3-Chat2026.01 | 0.152 | 0.155 | 0.125 | |
| PromptingModel=AF3-Think2026.01 | 0.144 | 0.122 | 0.1 |