Speech Translation on Callhome En-Es (devtest)
32.21BLEU ScoreTransformer (MT Baseline)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Transformer (MT Baseline)Paradigm=MT2023.05 | 32.21 | — | |
| CTC-NASTParadigm=NAR2023.05 | 23.43 | 4.1 | |
| CTC-Aug ST + Seq-KDParadigm=AR2023.05 | 23.09 | 1 | |
| CTC-Aug STParadigm=AR2023.05 | 22.16 | 1 | |
| Conformer + Seq-KDParadigm=AR, Backbone=Conformer, Reference=Inaguma et al., 2021a2023.05 | 21.5 | — | |
| Orthros - CTCParadigm=NAR, Reference=Inaguma et al., 2021a2023.05 | 21 | 1.09 | |
| Orthros - CMLMParadigm=NAR, Reference=Inaguma et al., 2021a2023.05 | 20.9 | 2.7 | |
| Transformer + Seq-KDParadigm=AR, Backbone=Transformer, Reference=Inaguma et al., 2021a2023.05 | 19.6 | — | |
| Self-conditioned CTCParadigm=NAR, Reference=Higuchi et al., 2021a2023.05 | 19.1 | — | |
| Intermediate CTCParadigm=NAR, Reference=Higuchi et al., 2021a2023.05 | 19 | — | |
| Conformer - CTCParadigm=NAR, Backbone=Conformer, Reference=Inaguma et al., 2021a2023.05 | 18 | 11.8 | |
| Mask - CTCParadigm=NAR, Reference=Higuchi et al., 2021a2023.05 | 17.9 | — | |
| Transformer + MTL + ASR init.Paradigm=AR, Backbone=Transformer, Reference=Chuang et al., 20212023.05 | 17.26 | — | |
| CTC + MTLParadigm=NAR, Reference=Chuang et al., 20212023.05 | 14.2 | 28.9 | |
| Transformer - CTCParadigm=NAR, Backbone=Transformer, Reference=Chuang et al., 20212023.05 | 13.02 | 28.9 |