Many-to-one Sign Language Translation on SP-10 (dev)
8.02csl BLEUIndividual (10)
Evaluation Results
| Method | Links | ||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Individual (10)Mode=Individual, Number of Models=102025.05 | 8.02 | 6.32 | 5.56 | 4.88 | 5.03 | 5.54 | 4.78 | 7.54 | 5.15 | 6.42 | 5.92 | 36.6 | 33.61 | 30.05 | 27.7 | 31.51 | 32.47 | 29.88 | 35.8 | 31.44 | 32.57 | 32.16 | |
| Sign2(LID+Text)Mode=Multilingual2025.05 | 7.06 | 6.77 | 7.38 | 3.56 | 6.59 | 5.59 | 4.83 | 7.76 | 4.54 | 7.79 | 6.19 | 36.77 | 34.86 | 36.02 | 26.74 | 35.64 | 34.95 | 31.67 | 37.97 | 31.43 | 37.56 | 34.36 | |
| Universal (1)Mode=Universal, Number of Models=12025.05 | 5.93 | 5.32 | 4.91 | 3.15 | 4.69 | 4.65 | 4.52 | 6.63 | 4.47 | 4.59 | 4.89 | 32.74 | 31.64 | 31.37 | 26.19 | 30.18 | 29.26 | 30.12 | 33.19 | 31.16 | 30.22 | 30.61 | |
| MLSTMode=Multilingual2025.05 | 5.16 | 5.42 | 4.95 | 3.28 | 6.76 | 5.18 | 7.05 | 6.33 | 6.08 | 7.03 | 5.72 | 34.59 | 34.04 | 31.62 | 27.98 | 35.29 | 33.5 | 37.96 | 36.02 | 34.48 | 37.25 | 34.27 | |
| Google multiMode=Multilingual2025.05 | 2.46 | 3.14 | 2.93 | 2.21 | 3.44 | 2.71 | 3.18 | 2.89 | 1.81 | 3.49 | 2.83 | 28.5 | 28.93 | 30.01 | 24.66 | 29.91 | 29.75 | 28.33 | 31.01 | 27.7 | 32.42 | 29.12 |