Pitch-accent quality assessment on Accent-error seen speaker (test) benchmark leaderboard · SOTA2 Research

Pitch-accent quality assessment on Accent-error seen speaker (test)

0.754Order AccuracyPASQA

Evaluation Results

Method
PASQA2026.06	0.754	0.829	0.711	0.524
PASQA w/o bradley-terry loss2026.06	0.723	0.837	0.678	0.478
PASQA w/o frame error head2026.06	0.721	0.836	0.658	0.463
ACC-SSL-MOS2026.06	0.71	0.811	0.666	0.472
PASQA w/o mora-conditioned fusion2026.06	0.695	0.761	0.628	0.441
PASQA w/o GRL2026.06	0.662	0.779	0.625	0.433
ACC-WORLD-MOS2026.06	0.346	0.02	0.036	0.025
DNSMOS P.8352026.06	0.2	-0.001	-0.001	-0.001
DNSMOS P.8082026.06	0.167	-0.031	-0.028	-0.019
UTMOSv22026.06	0.162	-0.009	-0.009	-0.006
NISQA2026.06	0.156	-0.01	0.011	0.007
SHEET SSL-MOS2026.06	0.139	-0.017	-0.049	-0.035
UTMOS2026.06	0.133	-0.02	-0.013	-0.009