Machine Translation on En -> De (test)
60.23BLEU ScoreCPCC
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CPCCModel Setting=Big2021.07 | 60.23 | 25.6 | |
| CPCCModel Setting=Base2021.07 | 60.13 | 25.4 | |
| Transformer+FTModel Setting=Big2021.07 | 59.01 | 26 | |
| V-Transformer+FTModel Setting=Base2021.07 | 58.74 | 26.3 | |
| V-Transformer+FTModel Setting=Big2021.07 | 58.7 | 26.2 | |
| Dia-Transformer+FTModel Setting=Big2021.07 | 58.68 | 26.8 | |
| Doc-Transformer+FTModel Setting=Big2021.07 | 58.61 | 26.5 | |
| Transformer+FTModel Setting=Base2021.07 | 58.43 | 26.7 | |
| Dia-Transformer+FTModel Setting=Base2021.07 | 58.33 | 26.8 | |
| Doc-Transformer+FTModel Setting=Base2021.07 | 58.15 | 27.1 | |
| TransformerModel Setting=Big2021.07 | 40.53 | 42.2 | |
| TransformerModel Setting=Base2021.07 | 40.02 | 42.5 | |
| K1-d&rSetting=Low Res, Avg. Train Hours=6.7 (2.3x)2021.03 | 33.44 | — | |
| K3-d&rSetting=Low Res, Avg. Train Hours=6.4 (1.8x)2021.03 | 33.36 | — | |
| K1Setting=High Res, Avg. Train Hours=13.0 (4.5x)2021.03 | 33.16 | — | |
| K1Setting=Low Res, Avg. Train Hours=2.9 (1.0x)2021.03 | 33.14 | — | |
| K3Setting=High Res, Avg. Train Hours=16.8 (4.8x)2021.03 | 33.1 | — | |
| K3-d&rSetting=High Res, Avg. Train Hours=22.3 (6.4x)2021.03 | 33.07 | — | |
| K0Setting=Sentence-level baseline2021.03 | 32.97 | — | |
| K3Setting=Low Res, Avg. Train Hours=3.5 (1.0x)2021.03 | 32.86 | — | |
| K1-d&rSetting=High Res, Avg. Train Hours=16.5 (5.7x)2021.03 | 32.82 | — | |
| KERMITtype=Insertion2019.06 | 27.8 | — | |
| Autoregressive (Transformer, GPT, GPT-2)type=Autoregressive2019.06 | 27.3 | — |