Co-speech gesture generation on BEAT All Speakers 2
8.103BCViBES
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| ViBEStraining_data=BEATv2 training split only2025.12 | 8.103 | 5.257 | 13.028 | — | — | — | — | |
| SynTalker2025.12 | 7.971 | 6.413 | 12.721 | — | — | — | — | |
| LOM2025.12 | 7.78 | 5.301 | 15.167 | — | — | — | — | |
| EMAGE2025.12 | 7.724 | 5.512 | 13.06 | — | — | — | — | |
| Habibie et al.2025.12 | 7.716 | 9.04 | 8.213 | — | — | — | — | |
| DiffStyleGesture2025.12 | 7.241 | 8.811 | 11.49 | — | — | — | — | |
| TalkSHOW2025.12 | 6.947 | 6.209 | 13.47 | — | — | — | — | |
| CaMN2025.12 | 6.769 | 6.644 | 10.86 | — | — | — | — | |
| DisCo2025.12 | 6.439 | 9.417 | 9.912 | — | — | — | — | |
| Gelina - FlowAblation=Without flow-matching decoding2025.10 | 0.824 | — | 4.28 | 0.6107 | 9.2 | 3.21 | 61.3 | |
| HolisticSemGes2026.03 | 0.78 | 2.247 | 120 | — | — | — | — | |
| Gelina S2GConfiguration=Speech-to-Gesture, Input=Ground-truth speech2025.10 | 0.768 | — | 4.03 | 0.195 | — | — | — | |
| EMAGE2025.10 | 0.766 | — | 3.92 | 0.1679 | — | — | — | |
| GelinaConfiguration=Base model2025.10 | 0.744 | — | 3.2 | 0.231 | 11.3 | 2.96 | — | |
| Gelina Clon.Configuration=Cloning, Conditioning=Speech-gesture input2025.10 | 0.738 | — | 3.15 | 0.0839 | 9.2 | 3.21 | 61.3 | |
| SemTalk2026.03 | 0.727 | 4.264 | 116 | — | — | — | — | |
| RAG2025.10 | 0.7 | — | 5.13 | 0.1781 | — | — | — | |
| EMAGE2026.03 | 0.692 | 5.521 | 88 | — | — | — | — | |
| Human2025.10 | 0.684 | — | 4.14 | 0 | 6.5 | 3.72 | 69.1 | |
| TokenizersDescription=Reconstruction from codecs without autoregressive modeling2025.10 | 0.667 | — | 3.91 | 0.0118 | 11.03 | 3.19 | 66.8 | |
| SHOW2026.03 | 0.652 | 6.204 | 82 | — | — | — | — | |
| CAMN2025.10 | 0.551 | — | 2.96 | 0.1097 | — | — | — | |
| Intentional-Gesturespeaker_mode=All Speakers2025.05 | 0.534 | 0.256 | 6.68 | — | — | — | — | |
| GestureLSMspeaker_mode=All Speakers2025.05 | 0.525 | 0.446 | 9.23 | — | — | — | — | |
| GestureLSM2026.03 | 0.525 | 4.268 | 112 | — | — | — | — | |
| Ground Truthspeaker_mode=All Speakers2025.05 | 0.477 | — | 7.29 | — | — | — | — | |
| RAGGesture2026.03 | 0.475 | 4.446 | 114 | — | — | — | — | |
| RAG-Gesturespeaker_mode=All Speakers2025.05 | 0.471 | 0.447 | 9.03 | — | — | — | — | |
| Audio2Photorealspeaker_mode=All Speakers2025.05 | 0.326 | 0.849 | 6.24 | — | — | — | — | |
| EMAGEspeaker_mode=All Speakers2025.05 | 0.284 | 0.632 | 6.06 | — | — | — | — | |
| CaMNspeaker_mode=All Speakers2025.05 | 0.2 | 0.512 | 5.58 | — | — | — | — | |
| CosyVoice-2System Type=Speech-only2025.10 | — | — | — | — | 3.5 | 3.7 | 63.9 | |
| Lina-SpeechSystem Type=Speech-only2025.10 | — | — | — | — | 10.9 | 2.98 | 60.1 |