Machine Translation on IWSLT Fr-En 2017 (test)
43.93BLEUFAAST
Evaluation Results
| Method | Links | |
|---|---|---|
| FAASTBackbone=Qwen2.5-7B-Instruct, Protocol=FAAST, Data Setting=full2026.05 | 43.93 | |
| FAASTBackbone=Qwen2.5-3B-Instruct, Protocol=FAAST, Data Setting=full2026.05 | 42.47 | |
| FAASTBackbone=Qwen2.5-7B-Instruct, Protocol=FAAST, Data Setting=1-shot2026.05 | 42.08 | |
| Qwen2.5-7B-InstructBackbone=Qwen2.5-7B-Instruct, Protocol=zero-shot, Data Setting=full2026.05 | 41.4 | |
| In-Context LearningBackbone=Qwen2.5-7B-Instruct, Protocol=In-Context Learning, Data Setting=1-shot2026.05 | 40.86 | |
| CipherDAug - 2 keyssrc aug=false, tgt aug=false, |Θ|=3x2022.04 | 40.35 | |
| Data Diversesrc aug=true, tgt aug=true, |Θ|=7x2022.04 | 39.58 | |
| FAASTBackbone=Qwen2.5-3B-Instruct, Protocol=FAAST, Data Setting=1-shot2026.05 | 39.46 | |
| CipherDAug - 1 keysrc aug=false, tgt aug=false, |Θ|=2x2022.04 | 39.45 | |
| BPE-dropoutSegmentation=BPE-dropout2019.10 | 39.39 | |
| BPE-Dropoutsrc aug=true, tgt aug=true, |Θ|=1x2022.04 | 39.39 | |
| Qwen2.5-3B-InstructBackbone=Qwen2.5-3B-Instruct, Protocol=zero-shot, Data Setting=full2026.05 | 39.24 | |
| Kudo (2018)Segmentation=Unigram Language Model2019.10 | 38.88 | |
| RAML+SwitchOutsrc aug=true, tgt aug=true, |Θ|=1x2022.04 | 38.85 | |
| In-Context LearningBackbone=Qwen2.5-3B-Instruct, Protocol=In-Context Learning, Data Setting=1-shot2026.05 | 38.51 | |
| RAMLsrc aug=false, tgt aug=true, |Θ|=1x2022.04 | 38.38 | |
| SwitchOutsrc aug=true, tgt aug=false, |Θ|=1x2022.04 | 38.2 | |
| BPESegmentation=BPE2019.10 | 38.18 | |
| Transformersrc aug=false, tgt aug=false, |Θ|=1x2022.04 | 38.18 | |
| LABOModel=Transformer2023.05 | 37.2 | |
| LSModel=Transformer2023.05 | 36.8 | |
| TransformerModel=Transformer2023.05 | 35.4 |