Audio Aesthetics Evaluation on Audiobox Aesthetics (AES) Sound
0.56PCC (CE)AES
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| AESevaluation_mode=Original code and weights2026.05 | 0.56 | 0.616 | 0.54 | 0.609 | 0.529 | 0.583 | 0.561 | 0.56 | |
| JASTINevaluation_mode=Original code and weights2026.05 | 0.542 | 0.618 | 0.495 | 0.569 | 0.549 | 0.58 | 0.529 | 0.514 | |
| Gemini-2.5-Proevaluation_mode=API2026.05 | 0.249 | 0.277 | 0.279 | 0.408 | 0.243 | 0.214 | 0.323 | 0.381 | |
| Qwen3-Omnievaluation_mode=Original code and weights2026.05 | 0.24 | 0.28 | 0.291 | 0.322 | 0.224 | 0.318 | 0.283 | 0.35 | |
| Gemini-3-Proevaluation_mode=API2026.05 | 0.232 | 0.365 | 0.307 | 0.384 | 0.2 | 0.321 | 0.408 | 0.34 | |
| Gemini-2.5-Flashevaluation_mode=API2026.05 | 0.204 | 0.249 | 0.228 | 0.409 | 0.179 | 0.201 | 0.211 | 0.324 | |
| AudioFlamingo3evaluation_mode=Original code and weights2026.05 | 0.049 | 0.226 | -0.063 | 0.169 | 0.067 | 0.323 | -0.092 | 0.098 | |
| NISQAevaluation_mode=Original code and weights2026.05 | 0.043 | -0.013 | -0.153 | -0.009 | 0.01 | 0.031 | -0.149 | -0.032 | |
| UTMOSevaluation_mode=Original code and weights2026.05 | -0.054 | -0.108 | 0.011 | -0.108 | -0.055 | -0.086 | 0.004 | -0.072 | |
| Qwen2-Audioevaluation_mode=Original code and weights2026.05 | -0.074 | 0.046 | -0.01 | -0.015 | -0.1 | 0.025 | -0.003 | -0.046 |