System naturalness prediction on ConvTTS (test)
0.57PCCConversational Speech Naturalness Predictor (Whisper)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Conversational Speech Naturalness Predictor (Whisper)Encoder=Whisper, Input Channel(s)=dual2026.03 | 0.57 | 0.56 | 0.218 | |
| Conversational Speech Naturalness Predictor (Whisper)Encoder=Whisper, Input Channel(s)=single2026.03 | 0.55 | 0.538 | 0.226 | |
| Conversational Speech Naturalness Predictor (AES)Encoder=AES, Input Channel(s)=dual2026.03 | 0.542 | 0.534 | 0.227 | |
| Conversational Speech Naturalness Predictor (AES)Encoder=AES, Input Channel(s)=single2026.03 | 0.523 | 0.523 | 0.234 | |
| Conversational Speech Naturalness Predictor (WavLM)Encoder=WavLM, Input Channel(s)=dual2026.03 | 0.517 | 0.522 | 0.236 | |
| Conversational Speech Naturalness Predictor (WavLM)Encoder=WavLM, Input Channel(s)=single2026.03 | 0.488 | 0.491 | 0.246 | |
| Conversational Speech Naturalness Predictor (Whisper)Encoder=Whisper, Input Channel(s)=dual2026.03 | 0.482 | 0.451 | 0.208 | |
| Conversational Speech Naturalness Predictor (AES)Encoder=AES, Input Channel(s)=dual2026.03 | 0.455 | 0.43 | 0.213 | |
| Conversational Speech Naturalness Predictor (Whisper)Encoder=Whisper, Input Channel(s)=single2026.03 | 0.433 | 0.406 | 0.221 | |
| Conversational Speech Naturalness Predictor (WavLM)Encoder=WavLM, Input Channel(s)=dual2026.03 | 0.409 | 0.358 | 0.227 | |
| Conversational Speech Naturalness Predictor (AES)Encoder=AES, Input Channel(s)=single2026.03 | 0.384 | 0.352 | 0.228 | |
| Conversational Speech Naturalness Predictor (WavLM)Encoder=WavLM, Input Channel(s)=single2026.03 | 0.331 | 0.279 | 0.242 |