Audio-driven Talking Head Generation on RAVDESS (cross-identity)
1.885FADDSM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DSMEmotion=Neutral2026.01 | 1.885 | 8.108 | 0.848 | |
| DSM+EATEmotion=Neutral2026.01 | 1.885 | 8.24 | 0.876 | |
| DSM+EATEmotion=Surprised2026.01 | 2.727 | 8.177 | 0.77 | |
| Ours_VDBackbone=DICE-Talk2026.04 | 2.973 | 7.497 | 0.795 | |
| Ours_CMBackbone=DICE-Talk2026.04 | 3.034 | 7.499 | 0.801 | |
| NED+EATEmotion=Neutral2026.01 | 3.073 | 8.05 | 0.838 | |
| ASCCLBackbone=DICE-Talk2026.04 | 3.106 | 7.638 | 0.785 | |
| BaselineBackbone=DICE-Talk2026.04 | 3.241 | 7.778 | 0.775 | |
| DSMEmotion=Surprised2026.01 | 3.292 | 8.008 | 0.763 | |
| DSM+EAMMEmotion=Neutral2026.01 | 3.353 | 8.374 | 0.845 | |
| DSM+EATEmotion=Happy2026.01 | 3.503 | 7.977 | 0.8 | |
| NEDEmotion=Neutral2026.01 | 3.559 | 7.906 | 0.82 | |
| DSMEmotion=Happy2026.01 | 3.818 | 8.259 | 0.801 | |
| DSM+EATEmotion=Avg.2026.01 | 3.879 | 8.053 | 0.775 | |
| DSMEmotion=Avg.2026.01 | 4.256 | 8.165 | 0.756 | |
| DSM+EATEmotion=Sad2026.01 | 4.395 | 8.06 | 0.76 | |
| DSMEmotion=Sad2026.01 | 4.426 | 7.98 | 0.745 | |
| DSM+EATEmotion=Angry2026.01 | 4.482 | 8.077 | 0.747 | |
| DSM+EATEmotion=Fear2026.01 | 4.489 | 8.044 | 0.748 | |
| DSM+EAMMEmotion=Sad2026.01 | 4.546 | 8.276 | 0.787 | |
| DSM+EAMMEmotion=Angry2026.01 | 4.558 | 8.426 | 0.727 | |
| NED+EATEmotion=Surprised2026.01 | 4.614 | 7.83 | 0.736 | |
| DSM+EAMMEmotion=Avg.2026.01 | 4.624 | 8.372 | 0.778 | |
| NED+EAMMEmotion=Neutral2026.01 | 4.663 | 8.225 | 0.803 | |
| DSM+EAMMEmotion=Happy2026.01 | 4.694 | 8.404 | 0.805 | |
| DSMEmotion=Angry2026.01 | 4.707 | 8.33 | 0.706 | |
| Ours_VDBackbone=NED2026.04 | 4.774 | 7.803 | 0.767 | |
| DSMEmotion=Fear2026.01 | 4.792 | 8.207 | 0.732 | |
| Ours_CMBackbone=NED2026.04 | 4.794 | 7.804 | 0.772 | |
| ASCCLBackbone=NED2026.04 | 4.808 | 7.82 | 0.761 | |
| NED+EATEmotion=Fear2026.01 | 4.836 | 7.974 | 0.74 | |
| DSM+EAMMEmotion=Disgusted2026.01 | 4.94 | 8.272 | 0.809 | |
| DSM+EAMMEmotion=Surprised2026.01 | 4.94 | 8.336 | 0.741 | |
| NEDEmotion=Fear2026.01 | 5.006 | 8.153 | 0.749 | |
| NED+EATEmotion=Avg.2026.01 | 5.126 | 7.874 | 0.777 | |
| NEDEmotion=Surprised2026.01 | 5.135 | 7.993 | 0.716 | |
| Ours_VDBackbone=EAT2026.04 | 5.189 | 7.44 | 0.732 | |
| Ours_CMBackbone=EAT2026.04 | 5.26 | 7.449 | 0.74 | |
| NED+EATEmotion=Angry2026.01 | 5.271 | 8.091 | 0.723 | |
| DSM+EAMMEmotion=Fear2026.01 | 5.336 | 8.514 | 0.731 | |
| NED+EATEmotion=Sad2026.01 | 5.37 | 7.767 | 0.765 | |
| NED+EAMMEmotion=Angry2026.01 | 5.375 | 8.319 | 0.759 | |
| NEDEmotion=Avg.2026.01 | 5.402 | 8.057 | 0.76 | |
| BaselineBackbone=NED2026.04 | 5.412 | 8.034 | 0.76 | |
| NED+EAMMEmotion=Sad2026.01 | 5.417 | 8.106 | 0.769 | |
| ASCCLBackbone=EAT2026.04 | 5.541 | 7.682 | 0.716 | |
| NEDEmotion=Angry2026.01 | 5.546 | 8.077 | 0.766 | |
| NED+EAMMEmotion=Fear2026.01 | 5.549 | 8.209 | 0.759 | |
| NEDEmotion=Sad2026.01 | 5.583 | 8.034 | 0.726 | |
| NEDEmotion=Happy2026.01 | 5.644 | 8.087 | 0.804 | |
| NED+EAMMEmotion=Avg.2026.01 | 5.675 | 8.162 | 0.779 | |
| NED+EATEmotion=Happy2026.01 | 5.787 | 7.932 | 0.833 | |
| BaselineBackbone=EAT2026.04 | 5.889 | 7.921 | 0.7 | |
| NED+EAMMEmotion=Disgusted2026.01 | 6.125 | 8.091 | 0.845 | |
| NED+EAMMEmotion=Surprised2026.01 | 6.187 | 8.348 | 0.697 | |
| NED+EAMMEmotion=Happy2026.01 | 6.415 | 7.836 | 0.82 | |
| DSM+EATEmotion=Disgusted2026.01 | 6.801 | 7.794 | 0.727 | |
| DSMEmotion=Disgusted2026.01 | 6.87 | 8.262 | 0.694 | |
| NED+EATEmotion=Disgusted2026.01 | 6.929 | 7.464 | 0.803 | |
| NEDEmotion=Disgusted2026.01 | 7.342 | 8.151 | 0.741 | |
| Ours_VDBackbone=ICface2026.04 | 8.9 | 10.315 | 0.687 | |
| Ours_CMBackbone=ICface2026.04 | 8.902 | 10.312 | 0.691 | |
| ASCCLBackbone=ICface2026.04 | 9.086 | 10.313 | 0.682 | |
| BaselineBackbone=ICface2026.04 | 9.424 | 11.539 | 0.677 |