Pitch-accent quality assessment on Accent-error evaluation set unseen speaker
78.7Order AccuracyPASQA w/o bradley-terry loss
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| PASQA w/o bradley-terry lossTrained on accent-error dataset=Yes2026.06 | 78.7 | 0.863 | 0.742 | 0.547 | |
| PASQATrained on accent-error dataset=Yes2026.06 | 78.5 | 0.879 | 0.751 | 0.559 | |
| PASQA w/o frame error headTrained on accent-error dataset=Yes2026.06 | 74.7 | 0.838 | 0.72 | 0.527 | |
| PASQA w/o GRLTrained on accent-error dataset=Yes2026.06 | 74.5 | 0.818 | 0.712 | 0.52 | |
| ACC-SSL-MOSTrained on accent-error dataset=Yes2026.06 | 73.8 | 0.818 | 0.724 | 0.53 | |
| PASQA w/o mora-conditioned fusionTrained on accent-error dataset=Yes2026.06 | 73.5 | 0.833 | 0.721 | 0.526 | |
| ACC-WORLD-MOSTrained on accent-error dataset=Yes2026.06 | 33.9 | 0.04 | 0.04 | 0.028 | |
| NISQATrained on accent-error dataset=No2026.06 | 19.5 | 0.004 | 0.006 | 0.004 | |
| SHEET SSL-MOSTrained on accent-error dataset=No2026.06 | 17.4 | -0.004 | -0.029 | -0.02 | |
| DNSMOS P.808Trained on accent-error dataset=No2026.06 | 17 | -0.029 | -0.025 | -0.017 | |
| UTMOSv2Trained on accent-error dataset=No2026.06 | 13.4 | -0.054 | -0.047 | -0.033 | |
| DNSMOS P.835Trained on accent-error dataset=No2026.06 | 12.1 | -0.073 | -0.057 | -0.04 | |
| UTMOSTrained on accent-error dataset=No2026.06 | 12.1 | -0.039 | -0.041 | -0.029 |