Many-to-one Sign Language Translation on SP-10 (test)
6.24csl BLEUIndividual (10)
Evaluation results
| Method | Links | ||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Individual (10)Mode=Individual, Number of Models=102025.05 | 6.24 | 4 | 3.69 | 3.63 | 3.3 | 3.77 | 3.4 | 6.21 | 4.49 | 6.23 | 4.6 | 34.51 | 30.93 | 30.9 | 27.19 | 28 | 30.19 | 27.66 | 33.92 | 31.36 | 35.73 | 31.04 | |
| Sign2(LID+Text)Mode=Multilingual2025.05 | 5.92 | 4.52 | 5.8 | 2.93 | 5.1 | 4.65 | 5 | 6.4 | 5.13 | 6.36 | 5.18 | 35.18 | 33.17 | 34.17 | 24.55 | 34.57 | 32.83 | 34.27 | 34.98 | 31.48 | 36.16 | 33.14 | |
| MLSTMode=Multilingual2025.05 | 5.19 | 4.18 | 3.66 | 2.85 | 3.93 | 4.97 | 6.7 | 3.7 | 5.72 | 5.73 | 4.66 | 33.33 | 34.07 | 31.54 | 25.75 | 33.25 | 32.13 | 35.37 | 33.09 | 33.11 | 35.34 | 32.7 | |
| Universal (1)Mode=Universal, Number of Models=12025.05 | 2.72 | 2.36 | 2.19 | 3.02 | 4.14 | 3.31 | 1.19 | 3.94 | 3.2 | 4.7 | 3.1 | 29.57 | 29.03 | 28.96 | 26.66 | 31.75 | 30.12 | 26.73 | 31.11 | 30.33 | 32.41 | 29.67 | |
| Google multiMode=Multilingual2025.05 | 2.28 | 2.38 | 2.06 | 1.1 | 1.38 | 1.82 | 2.09 | 2.13 | 2.68 | 3.27 | 2.12 | 29.37 | 28.63 | 29.57 | 23.95 | 28.53 | 29.36 | 29.3 | 29.83 | 30.03 | 30.76 | 28.93 |