How2Sign
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
How2Sign (test)
24.6BLEU-4
94
How2Sign (test)
21.03BLEU-4
21
How2Sign
4.28DTW-PA-JPE (Body)
10
How2Sign
15.5BLEU-4
9
How2Sign (dev)
35.2BLEU-1
7
How2Sign
6.82DTW PA-JPE (Body)
7
How2Sign (dev)
25.55BLEU-4
6
How2Sign (test)
39.57F1@0.50
5
How2Sign (val)
38.32F1@0.50
5
How2Sign
2.65User Study Score
5
How2Sign Faces (test)
87.22FVD16
5
How2Sign (test)
5.9Latency (s)
4
How2Sign
0.734Inference Latency (s/video)
3
How2Sign-Faces (test)
0.939GT Identity Score
3
How2Sign Faces (test)
0.804GT-ID
3
How2Sign (dev)
17.73BLEU-1
2
How2Sign-Faces (test)
0.768GT-ID
2
How2Sign-Faces (test)
0.702GT ID
2
How2Sign-Faces (test)
70.3GT ID
2
How2Sign-Faces (test)
0.758GT-ID
2
How2Sign (test)
1.97Base B4 Score
1
How2Sign (val)
2.79rBLEU
1