Speech Translation on Callhome En-Es (test)
31.58BLEUTransformer (MT Baseline)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Transformer (MT Baseline)Paradigm=MT2023.05 | 31.58 | — | |
| CTC-NASTParadigm=NAR2023.05 | 23.3 | 4.1 | |
| CTC-Aug ST + Seq-KDParadigm=AR2023.05 | 22.92 | 1 | |
| CTC-Aug STParadigm=AR2023.05 | 21.33 | 1 | |
| Conformer + Seq-KDParadigm=AR, Backbone=Conformer, Reference=Inaguma et al., 2021a2023.05 | 21 | — | |
| Orthros - CTCParadigm=NAR, Reference=Inaguma et al., 2021a2023.05 | 20.8 | 1.09 | |
| Orthros - CMLMParadigm=NAR, Reference=Inaguma et al., 2021a2023.05 | 20.4 | 2.7 | |
| Transformer + Seq KDParadigm=AR, Backbone=Transformer, Reference=Inaguma et al., 2021b2023.05 | 19.81 | — | |
| Transformer + Seq-KDParadigm=AR, Backbone=Transformer, Reference=Inaguma et al., 2021a2023.05 | 19.2 | — | |
| Self-conditioned CTCParadigm=NAR, Reference=Higuchi et al., 2021a2023.05 | 19.2 | — | |
| Intermediate CTCParadigm=NAR, Reference=Higuchi et al., 2021a2023.05 | 19 | — | |
| Conformer - CTCParadigm=NAR, Backbone=Conformer, Reference=Inaguma et al., 2021a2023.05 | 18.7 | 11.8 | |
| Mask - CTCParadigm=NAR, Reference=Higuchi et al., 2021a2023.05 | 18.3 | — | |
| Transformer + MTL + ASR init.Paradigm=AR, Backbone=Transformer, Reference=Chuang et al., 20212023.05 | 17.45 | — | |
| CTCParadigm=NAR, Reference=Inaguma et al., 2021b2023.05 | 15.91 | 20.84 | |
| CTC + MTLParadigm=NAR, Reference=Chuang et al., 20212023.05 | 14.19 | 28.9 | |
| Transformer - CTCParadigm=NAR, Backbone=Transformer, Reference=Chuang et al., 20212023.05 | 13.52 | 28.9 |