Binaural Speech Generation on MRSDrama complete drama
0.007IPD MAESpatialization
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| SpatializationDescription=generation of binaural audio directly from the GT monaural audio input based on the geometric pose2025.04 | 0.007 | 0.043 | 0.58 | 0.79 | 4.09 | 4.26 | |
| ISDramaPrompt Modality=geometric2025.04 | 0.008 | 0.046 | 0.51 | 0.75 | 4.01 | 4.18 | |
| F5-TTSBinaural spatialization model=BinauralGrad [39]2025.04 | 0.009 | 0.053 | 0.45 | 0.7 | 3.66 | 4.11 | |
| ISDramaPrompt Modality=video2025.04 | 0.009 | 0.051 | 0.48 | 0.73 | 3.97 | 4.09 | |
| FireRedTTSBinaural spatialization model=BinauralGrad [39]2025.04 | 0.01 | 0.051 | 0.42 | 0.65 | 3.78 | 3.97 | |
| StyleTTS2Binaural spatialization model=BinauralGrad [39]2025.04 | 0.011 | 0.064 | 0.33 | 0.61 | 3.63 | 3.81 | |
| CosyVoiceBinaural spatialization model=BinauralGrad [39]2025.04 | 0.011 | 0.055 | 0.44 | 0.68 | 3.72 | 4.02 | |
| ISDramaPrompt Modality=textual2025.04 | 0.011 | 0.055 | 0.43 | 0.68 | 3.95 | 4.41 | |
| UniaudioBinaural spatialization model=BinauralGrad [39]2025.04 | 0.012 | 0.06 | 0.38 | 0.64 | 3.65 | 3.89 |