Sign Language Translation on OpenASL (test)
51.44BLEU-1 ScoreSignDPO
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| SignDPO2026.04 | 51.44 | — | — | — | — | — | 24.35 | 46.29 | |
| SignDPO2026.04 | 51.44 | — | — | — | 37.94 | 29.93 | 24.35 | 46.29 | |
| Sigma2025.09 | 49.91 | — | — | — | — | — | 23.21 | 45.38 | |
| Uni-SignModality=Pose+RGB, Protocol=Gloss-free SLT2025.01 | 49.35 | — | — | 43.22 | — | — | 23.14 | — | |
| Uni-SignModality=RGB, Gloss-free=true2025.01 | 49.35 | — | 60.4 | 43.22 | 36.32 | 28.55 | 23.14 | — | |
| Uni-Sign2025.09 | 49.35 | — | — | — | — | — | 23.14 | 43.22 | |
| Uni-Sign2026.04 | 49.35 | — | — | — | — | — | 23.14 | 43.22 | |
| Uni-Sign2026.04 | 49.35 | — | — | — | 36.32 | 28.55 | 23.14 | 43.22 | |
| Uni-SignModality=Pose, Protocol=Gloss-free SLT2025.01 | 49.1 | — | — | 42.77 | — | — | 22.67 | — | |
| Uni-SignModality=Pose, Gloss-free=true2025.01 | 49.1 | — | 60.08 | 42.77 | 35.91 | 28.12 | 22.67 | — | |
| C2RLModality=Pose, Protocol=Gloss-free SLT2025.01 | 42.45 | — | — | 39.18 | — | — | 12.23 | — | |
| CRLModality=RGB, Protocol=Gloss-free SLT2025.01 | 31.46 | — | — | 31.36 | — | — | 13.21 | — | |
| C2RLModality=Pose+RGB, Gloss-free=true2025.01 | 31.46 | — | — | 31.36 | 21.85 | 16.58 | 13.21 | — | |
| C^2RL2025.09 | 31.46 | — | — | — | — | — | 13.21 | 31.36 | |
| C^2RL2026.04 | 31.46 | — | — | — | — | — | 13.21 | 31.36 | |
| C^2RL2026.04 | 31.46 | — | — | — | 21.85 | 16.58 | 13.21 | 31.36 | |
| GloFEAnchor word type=VN (Verbs and Nouns)2023.05 | 21.56 | — | 36.35 | 21.75 | 12.74 | 9.05 | 7.06 | — | |
| GloFE-VNModality=Pose, Protocol=Gloss-free SLT2025.01 | 21.56 | — | — | 21.75 | — | — | 7.06 | — | |
| GloFE-VNModality=RGB, Gloss-free=true2025.01 | 21.56 | — | 36.35 | 21.75 | 12.74 | 9.05 | 7.06 | — | |
| GloFE-VN2025.09 | 21.56 | — | — | — | — | — | 7.06 | 21.75 | |
| GloFE-VN2026.04 | 21.56 | — | — | — | — | — | 7.06 | 21.75 | |
| GloFE-VN2026.04 | 21.56 | — | — | — | 12.74 | 9.05 | 7.06 | 21.75 | |
| OpenASL2023.05 | 20.92 | — | 31.09 | 21.02 | 12.08 | 8.59 | 6.72 | — | |
| TransformerApproach=Supervised, Authors=Shi et al., 20222024.02 | 20.92 | — | — | — | — | — | 6.72 | — | |
| OpenASLModality=Pose, Protocol=Gloss-free SLT2025.01 | 20.92 | — | — | 21.02 | — | — | 8.59 | — | |
| OpenASLModality=RGB, Gloss-free=true2025.01 | 20.92 | — | 31.09 | 21.02 | 12.08 | 8.59 | 6.72 | — | |
| OpenASL2025.09 | 20.92 | — | — | — | — | — | 6.72 | 21.02 | |
| OpenASL2026.04 | 20.92 | — | — | — | — | — | 6.72 | 21.02 | |
| OpenASL2026.04 | 20.92 | — | — | — | 12.08 | 8.59 | 6.72 | 21.02 | |
| USLNetApproach=Supervised, Setting=U+S2024.02 | 20.9 | — | — | — | — | — | 6.3 | — | |
| GloFEAnchor word type=N (Nouns)2023.05 | 20.49 | — | 36.68 | 21.23 | 12.27 | 8.76 | 6.82 | — | |
| I3D-transformer2023.05 | 18.31 | — | 28.82 | 18.64 | 10.15 | 7.19 | 5.66 | — | |
| I3D-transformerModality=Pose, Protocol=Gloss-free SLT2025.01 | 18.31 | — | — | 18.64 | — | — | 5.66 | — | |
| I3D-transformerModality=RGB, Gloss-free=true2025.01 | 18.31 | — | 28.82 | 18.64 | 10.15 | 7.19 | 5.66 | — | |
| I3D-transformer2025.09 | 18.31 | — | — | — | — | — | 5.56 | 18.64 | |
| I3D-transformer2026.04 | 18.31 | — | — | — | — | — | 5.56 | 18.64 | |
| I3D-transformer2026.04 | 18.31 | — | — | — | 10.15 | 7.19 | 5.56 | 18.64 | |
| USLNetApproach=Supervised, Setting=S2024.02 | 16.9 | — | — | — | — | — | 4.3 | — | |
| Conv-GRU2023.05 | 16.11 | — | 25.65 | 16.1 | 8.85 | 6.18 | 4.58 | — | |
| Conv-GRUApproach=Supervised2024.02 | 16.11 | — | — | — | — | — | 4.58 | — | |
| Conv-GRUModality=Pose, Protocol=Gloss-free SLT2025.01 | 16.11 | — | — | 16.1 | — | — | 4.58 | — | |
| Conv-GRUModality=Pose, Gloss-free=true2025.01 | 16.11 | — | 25.65 | 16.1 | 8.85 | 6.18 | 4.58 | — | |
| Conv-GRU2025.09 | 16.11 | — | — | — | — | — | 4.58 | 16.1 | |
| Conv-GRU2026.04 | 16.11 | — | — | — | — | — | 4.58 | 16.1 | |
| Conv-GRU2026.04 | 16.11 | — | — | — | 8.85 | 6.18 | 4.58 | 16.1 | |
| USLNetApproach=Unsupervised, Setting=w. joint training2024.02 | 12.4 | — | — | — | — | — | 1.2 | — | |
| USLNetApproach=Unsupervised, Setting=w/o. joint training2024.02 | 1.3 | — | — | — | — | — | 0 | — | |
| C2RLSSL=false2024.11 | — | 13.2 | — | — | — | — | — | — | |
| GloFE-VNSSL=false2024.11 | — | 7.1 | 36.7 | — | — | — | — | — | |
| Method [54]Without glosses=true, Domain=Youtube (news + vlogs), Duration(h) val=288, Vocabulary(K) val=332023.04 | — | 6.72 | — | — | — | — | — | — | |
| OpenASLSSL=false2024.11 | — | 6.7 | 31.1 | — | — | — | — | — | |
| SHuBERTSSL=true, PT data (hrs)=9842024.11 | — | 23.2 | 60.6 | — | — | — | — | — | |
| Uni-SignSSL=false, PT data (hrs)=984, Pre-training Source=YouTube-ASL2024.11 | — | 23.1 | 60.4 | — | — | — | — | — | |
| VAPSSL=false2024.11 | — | 21.2 | — | — | — | — | — | — |