Pitch-accent quality assessment on Accent-error evaluation set unseen speaker benchmark leaderboard · SOTA2 Research

Pitch-accent quality assessment on Accent-error evaluation set unseen speaker

78.7Order AccuracyPASQA w/o bradley-terry loss

Evaluation Results

Method
PASQA w/o bradley-terry loss2026.06	78.7	0.863	0.742	0.547
PASQA2026.06	78.5	0.879	0.751	0.559
PASQA w/o frame error head2026.06	74.7	0.838	0.72	0.527
PASQA w/o GRL2026.06	74.5	0.818	0.712	0.52
ACC-SSL-MOS2026.06	73.8	0.818	0.724	0.53
PASQA w/o mora-conditioned fusion2026.06	73.5	0.833	0.721	0.526
ACC-WORLD-MOS2026.06	33.9	0.04	0.04	0.028
NISQA2026.06	19.5	0.004	0.006	0.004
SHEET SSL-MOS2026.06	17.4	-0.004	-0.029	-0.02
DNSMOS P.8082026.06	17	-0.029	-0.025	-0.017
UTMOSv22026.06	13.4	-0.054	-0.047	-0.033
DNSMOS P.8352026.06	12.1	-0.073	-0.057	-0.04
UTMOS2026.06	12.1	-0.039	-0.041	-0.029