Speech to gesture translation on Speech2Gesture 1.0 (test)
6.7Fooled Rate (%)Median
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Medianvideo_duration=12 seconds2019.06 | 6.7 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RNNvideo_duration=12 seconds2019.06 | 10 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RNNvideo_duration=12 seconds2019.06 | 19.4 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Ours, no GANvideo_duration=12 seconds, adversarial_training=false2019.06 | 19.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Ours, GANvideo_duration=12 seconds, adversarial_training=true2019.06 | 22 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Medianvideo_duration=12 seconds2019.06 | 25.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| NNvideo_duration=12 seconds2019.06 | 26.4 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Ours, GANvideo_duration=12 seconds, adversarial_training=true2019.06 | 27.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Randomvideo_duration=12 seconds2019.06 | 29.1 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Ours, no GANvideo_duration=12 seconds, adversarial_training=false2019.06 | 33.1 | — | — | — | — | — | — | — | — | — | — | — | — | |
| NNvideo_duration=12 seconds2019.06 | 33.3 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Randomvideo_duration=12 seconds2019.06 | 34.3 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Mediantype=Baseline2019.06 | — | 66 | 69 | 79 | 63 | 75 | 80 | 80 | 70 | 74 | 76 | 73 | 38.11 | |
| NNtype=Baseline2019.06 | — | 88 | 96 | 105 | 93 | 102 | 111 | 110 | 99 | 101 | 106 | 101 | 27.92 | |
| Ours, GANAdversarial Loss=true2019.06 | — | 77 | 63 | 64 | 68 | 81 | 74 | 70 | 72 | 78 | 83 | 73 | 41.95 | |
| Ours, no GANAdversarial Loss=false2019.06 | — | 57 | 60 | 63 | 61 | 71 | 72 | 68 | 69 | 75 | 76 | 67 | 44.62 | |
| Randomtype=Baseline2019.06 | — | 93 | 100 | 110 | 94 | 107 | 111 | 112 | 100 | 104 | 108 | 104 | 26.55 | |
| RNNtype=Baseline2019.06 | — | 61 | 66 | 76 | 62 | 71 | 74 | 73 | 72 | 72 | 75 | 70 | 39.69 |