Pitch-accent quality assessment on Accent-error seen speaker (test)
0.754Order AccuracyPASQA
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| PASQATrained on accent-error dataset=Yes2026.06 | 0.754 | 0.829 | 0.711 | 0.524 | |
| PASQA w/o bradley-terry lossTrained on accent-error dataset=Yes2026.06 | 0.723 | 0.837 | 0.678 | 0.478 | |
| PASQA w/o frame error headTrained on accent-error dataset=Yes2026.06 | 0.721 | 0.836 | 0.658 | 0.463 | |
| ACC-SSL-MOSTrained on accent-error dataset=Yes2026.06 | 0.71 | 0.811 | 0.666 | 0.472 | |
| PASQA w/o mora-conditioned fusionTrained on accent-error dataset=Yes2026.06 | 0.695 | 0.761 | 0.628 | 0.441 | |
| PASQA w/o GRLTrained on accent-error dataset=Yes2026.06 | 0.662 | 0.779 | 0.625 | 0.433 | |
| ACC-WORLD-MOSTrained on accent-error dataset=Yes2026.06 | 0.346 | 0.02 | 0.036 | 0.025 | |
| DNSMOS P.835Trained on accent-error dataset=No2026.06 | 0.2 | -0.001 | -0.001 | -0.001 | |
| DNSMOS P.808Trained on accent-error dataset=No2026.06 | 0.167 | -0.031 | -0.028 | -0.019 | |
| UTMOSv2Trained on accent-error dataset=No2026.06 | 0.162 | -0.009 | -0.009 | -0.006 | |
| NISQATrained on accent-error dataset=No2026.06 | 0.156 | -0.01 | 0.011 | 0.007 | |
| SHEET SSL-MOSTrained on accent-error dataset=No2026.06 | 0.139 | -0.017 | -0.049 | -0.035 | |
| UTMOSTrained on accent-error dataset=No2026.06 | 0.133 | -0.02 | -0.013 | -0.009 |