Sign Language Translation on OpenASL (dev)
52.83BLEU-1SignDPO
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| SignDPO2026.04 | 52.83 | — | — | — | 26.98 | — | 46.7 | |
| SignDPO2026.04 | 52.83 | — | 38.12 | 31.8 | 26.98 | — | 46.7 | |
| Sigma2025.09 | 51.68 | — | — | — | 25.72 | — | 45.81 | |
| Uni-SignModality=RGB, Gloss-free=true2025.01 | 50.84 | 44.58 | 37.82 | 29.83 | 24.16 | 61.28 | — | |
| Uni-Sign2025.09 | 50.84 | — | — | — | 24.16 | — | 44.58 | |
| Uni-Sign2026.04 | 50.84 | — | — | — | 24.16 | — | 44.58 | |
| Uni-Sign2026.04 | 50.84 | — | 37.82 | 29.83 | 24.16 | — | 44.58 | |
| Uni-SignModality=Pose, Gloss-free=true2025.01 | 49.52 | 42.64 | 36.06 | 28.06 | 22.39 | 60.47 | — | |
| GloFEAnchor word type=N (Nouns)2023.05 | 21.78 | 21.63 | 13.35 | 9.61 | 7.51 | 37.3 | — | |
| GloFEAnchor word type=VN (Verbs and Nouns)2023.05 | 21.06 | 21.37 | 12.34 | 8.68 | 6.68 | 36.75 | — | |
| GloFE-VNModality=RGB, Gloss-free=true2025.01 | 21.06 | 21.37 | 12.34 | 8.68 | 6.68 | 36.75 | — | |
| GloFE-VN2025.09 | 21.06 | — | — | — | 6.68 | — | 21.37 | |
| GloFE-VN2026.04 | 21.06 | — | — | — | 6.68 | — | 21.37 | |
| GloFE-VN2026.04 | 21.06 | — | 12.34 | 8.68 | 6.68 | — | 21.37 | |
| OpenASL2023.05 | 20.1 | 20.43 | 11.81 | 8.43 | 6.57 | 31.22 | — | |
| TransformerApproach=Supervised, Authors=Shi et al., 20222024.02 | 20.1 | — | — | — | — | — | — | |
| OpenASLModality=RGB, Gloss-free=true2025.01 | 20.1 | 20.43 | 11.81 | 8.43 | 6.57 | 31.22 | — | |
| OpenASL2025.09 | 20.1 | — | — | — | 6.57 | — | 20.43 | |
| OpenASL2026.04 | 20.1 | — | — | — | 6.57 | — | 20.43 | |
| OpenASL2026.04 | 20.1 | — | 11.81 | 8.43 | 6.57 | — | 20.43 | |
| USLNetApproach=Supervised, Setting=U+S2024.02 | 19.3 | — | — | — | — | — | — | |
| I3D-transformer2023.05 | 18.26 | 18.88 | 10.26 | 7.17 | 5.6 | 29.17 | — | |
| I3D-transformerModality=RGB, Gloss-free=true2025.01 | 18.26 | 18.88 | 10.26 | 7.17 | 5.6 | 29.17 | — | |
| I3D-transformer2025.09 | 18.26 | — | — | — | 5.6 | — | 18.88 | |
| I3D-transformer2026.04 | 18.26 | — | — | — | 5.6 | — | 18.88 | |
| I3D-transformer2026.04 | 18.26 | — | 10.26 | 7.17 | 5.6 | — | 18.88 | |
| Conv-GRU2023.05 | 16.72 | 16.25 | 8.95 | 6.31 | 4.82 | 25.36 | — | |
| Conv-GRUApproach=Supervised2024.02 | 16.72 | — | — | — | — | — | — | |
| Conv-GRUModality=Pose, Gloss-free=true2025.01 | 16.72 | 16.25 | 8.95 | 6.31 | 4.82 | 25.36 | — | |
| Conv-GRU2025.09 | 16.72 | — | — | — | 4.82 | — | 16.25 | |
| Conv-GRU2026.04 | 16.72 | — | — | — | 4.82 | — | 16.25 | |
| Conv-GRU2026.04 | 16.72 | — | 8.95 | 6.31 | 4.82 | — | 16.25 | |
| USLNetApproach=Supervised, Setting=S2024.02 | 15.4 | — | — | — | — | — | — | |
| USLNetApproach=Unsupervised, Setting=w. joint training2024.02 | 14.5 | — | — | — | — | — | — | |
| USLNetApproach=Unsupervised, Setting=w/o. joint training2024.02 | 1.6 | — | — | — | — | — | — |