Sign Language Translation on How2Sign (val)
2.79rBLEUTransformer
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| TransformerText preprocessing=yes, Vocabulary size=1k, Batch size=64, Learning Rate=1e-3, LR scheduler=inv_sqrt, Warm-up steps=4k, Warm restarts period=0, Weight Decay=1e-3, Label Smoothing=0.1, Dropout=0.1, # Layers (encoder-decoder)=3-3, Embed dim=512, FFN dim=2048, # Attention heads=82023.04 | 2.79 | 35.2 | 20.62 | 13.25 | 8.89 |