Speech-driven Holistic Expression and Gesture Generation on BEAT 2022 (test)
324.67FMDDiffSHEG
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| DiffSHEG2024.01 | 324.67 | 331.72 | 53.9 | 438.93 | 91.4 | 25.1 | 53.6 | |
| Ours Naïve Concat2024.01 | 354.6 | 354.6 | 52.6 | 497.28 | 91.4 | 25.3 | 50.3 | |
| Ours Reverse Direction2024.01 | 357.56 | 369.72 | 58.3 | 472.38 | 91.3 | 24.5 | 55.3 | |
| Ours w/o E0(t)2024.01 | 369.97 | 366.37 | 51.9 | 477 | 91.7 | 25.1 | 50.4 | |
| Ours w/o Detach2024.01 | 375.98 | 384.31 | 51.3 | 475.19 | 91.7 | 24.7 | 51.7 | |
| LDAExpression Gen=true, Gesture Gen=true2024.01 | 688.25 | 510.345 | 60.3 | 997.62 | 92.3 | 21.5 | 68.8 | |
| CaMNExpression Gen=false, Gesture Gen=false2024.01 | 1,055.52 | 1,324 | 47.9 | 1,635.44 | 79.3 | 19.7 | 63.3 | |
| DiffuseStyleGesture (DSG)Expression Gen=true, Gesture Gen=true2024.01 | 1,261.59 | 998.25 | 68.8 | 1,907.58 | 91.9 | 20.4 | 70.1 | |
| DiffGestureExpression Gen=true, Gesture Gen=false2024.01 | 12,142.7 | 586.45 | 62.5 | 23,700.91 | 92.9 | 9.6 | 328.4 |