English-German document-level translation on News English-German (test)
30.34s-BLEUG-Transformer+mBART
Evaluation results
| Method | Links | ||
|---|---|---|---|
| G-Transformer+mBARTPre-training Setting=mBART2023.05 | 30.34 | 31.71 | |
| G-Transformer + Back-translation (doc) + Target-side augmentationContext Level=document-level, Data Augmentation=Back-translation + Target-side augmentation2023.05 | 28.69 | 30.41 | |
| G-Transformer (fnt.) + Target-side augmentationInitialization=fine-tuned (fnt.), Context Level=document-level, Data Augmentation=Target-side augmentation2023.05 | 28.06 | 29.83 | |
| Transformer + Back-translation (sent) + Target-side augmentationContext Level=sentence-level, Data Augmentation=Back-translation + Target-side augmentation2023.05 | 28.01 | — | |
| Transformer (sent baseline) + Target-side data augmentationContext Level=sentence-level, Data Augmentation=Target-side augmentation2023.05 | 27.03 | — | |
| G-Transformer + Back-translation (doc)Context Level=document-level, Data Augmentation=Back-translation2023.05 | 26.25 | 28.21 | |
| G-Transformer+BERTPre-training Setting=BERT2023.05 | 26.14 | — | |
| Transformer + Back-translation (sent)Context Level=sentence-level, Data Augmentation=Back-translation2023.05 | 26.07 | — | |
| SMDT2023.05 | 25.76 | — | |
| RecurrentMem2023.05 | 25.73 | 27.78 | |
| G-TransformerInitialization=fine-tuned (fnt.)2023.05 | 25.52 | 27.11 | |
| G-Transformer (fnt.) (doc baseline)Initialization=fine-tuned (fnt.), Context Level=document-level2023.05 | 25.12 | 27.02 | |
| HAN2023.05 | 25.03 | — | |
| MultiResolution2023.05 | 25 | 26.71 | |
| Hybrid Context2023.05 | 24.91 | — | |
| SAN2023.05 | 24.84 | — | |
| Transformer (sent baseline)Context Level=sentence-level2023.05 | 24.82 | — | |
| Flat-Transformer+BERTPre-training Setting=BERT2023.05 | 24.52 | — | |
| Flat-Transformer2023.05 | 23.55 | — | |
| G-TransformerInitialization=random (rnd.)2023.05 | 23.55 | 25.23 |