Gesture Synchronisation on LRS3
38.2P25 ErrorConv. + LSTM baseline
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Conv. + LSTM baselineInput=Keypoint-vector2023.10 | 38.2 | 40.3 | 47.7 | 54.8 | |
| Conv. + LSTM baselineInput=Keypoint-image2023.10 | 39.1 | 47.2 | 52.3 | 63.6 | |
| Transformer (with temporal attn.)Input=Keypoint-vector2023.10 | 40.6 | 43.5 | 49.9 | 56.5 | |
| GestSync (Transformer with Fact. attn.)Input=Keypoint-vector2023.10 | 41.7 | 49.8 | 58.1 | 62.7 | |
| GestSync (Image based Transformer)Input=Keypoint-image2023.10 | 43 | 51 | 58.2 | 61.6 | |
| Conv. + LSTM baselineInput=RGB2023.10 | 49.8 | 59.3 | 68.2 | 75.7 | |
| GestSync (Image based Transformer)Input=RGB2023.10 | 53.7 | 66.1 | 72.6 | 77.5 |