Speech Translation on MuST-C COMMON (tst)
16.5WER (de)Multilingual one-to-many (single model)
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Multilingual one-to-many (single model)type=Multilingual one-to-many, Note=single model trained on 8 languages2020.11 | 16.5 | 18.9 | 24.5 | 16.2 | 17.8 | 20.8 | 15.9 | 9.8 | 17.55 | |
| Multilingual one-to-many (split train)type=Multilingual one-to-many, Note=trained separately for {de,nl} and {es,fr,it,pt}2020.11 | 17.7 | 20.9 | 26.5 | 18 | 20 | 22.6 | — | — | — | |
| ST transf-base + AFSSystem Type=End-to-End, Architecture=ST transf-base + AFS2020.12 | 22.4 | 26.9 | 31.6 | 23 | 24.9 | 26.3 | 21 | 14.7 | 23.9 | |
| fairseq-ST ST transf-sSystem Type=End-to-End, Architecture=ST transf-s2020.12 | 22.7 | 27.2 | 32.9 | 22.7 | 27.3 | 28.1 | 21.9 | 15.3 | 24.8 | |
| par++type=par++, side=both, self=true, src=true, merge=concat, epochs=252020.11 | 22.74 | 27.59 | 32.86 | 23.5 | 26.97 | 29.51 | 21.94 | 14.88 | 25 | |
| NeurST ST transf-sSystem Type=End-to-End, Architecture=ST transf-s2020.12 | 22.8 | 27.4 | 33.3 | 22.9 | 27.2 | 28.7 | 22.2 | 15.1 | 24.9 | |
| independent++type=independent++, epochs=252020.11 | 22.82 | 27.2 | 32.11 | 23.34 | 26.67 | 28.98 | 21.37 | 14.34 | 24.6 | |
| parR3type=parR3, side=both, self=false, src=true, merge=sum, epochs=252020.11 | 22.84 | 27.92 | 32.12 | 23.61 | 27.29 | 29.48 | 21.16 | 14.5 | 24.87 | |
| ESPnet-ST ST transf-sSystem Type=End-to-End, Architecture=ST transf-s2020.12 | 22.9 | 28 | 32.8 | 23.8 | 27.4 | 28 | 21.9 | 15.8 | 25.1 | |
| Bilingual one-to-onetype=Bilingual one-to-one, epochs=502020.11 | 22.91 | 27.96 | 32.69 | 23.75 | 27.43 | 28.01 | 21.9 | 15.75 | 25.05 | |
| NeurST ASR transf-s → MTSystem Type=Cascade, Components=ASR transf-s -> MT2020.12 | 23.4 | 28 | 33.9 | 23.8 | 27.1 | 28.3 | 22.2 | 16 | 25.3 | |
| par++type=par++, side=both, self=false, src=true, merge=sum, epochs=252020.11 | 23.63 | 28.12 | 33.45 | 24.18 | 27.55 | 29.95 | 22.87 | 15.21 | 25.62 | |
| ESPnet-ST ASR transf-s + CTC → MTSystem Type=Cascade, Components=ASR transf-s + CTC -> MT2020.12 | 23.7 | 28.7 | 33.8 | 24 | 27.9 | 29 | 22.7 | 16.4 | 25.8 |