List your company
ResearchFormerly WizWand

Machine Translation on IWSLT Fr-En 2017 (test)

43.93BLEUFAAST
35.058837.361939.66541.9681Oct 29, 2019Nov 28, 2020Dec 30, 2021Jan 31, 2023Mar 3, 2024Apr 4, 2025May 6, 2026
Updated 5mo ago

Evaluation results

MethodLinks
FAASTBackbone=Qwen2.5-7B-Instruct, Protocol=FAAST, Data Setting=full2026.0543.93
FAASTBackbone=Qwen2.5-3B-Instruct, Protocol=FAAST, Data Setting=full2026.0542.47
FAASTBackbone=Qwen2.5-7B-Instruct, Protocol=FAAST, Data Setting=1-shot2026.0542.08
Qwen2.5-7B-InstructBackbone=Qwen2.5-7B-Instruct, Protocol=zero-shot, Data Setting=full2026.0541.4
In-Context LearningBackbone=Qwen2.5-7B-Instruct, Protocol=In-Context Learning, Data Setting=1-shot2026.0540.86
CipherDAug - 2 keyssrc aug=false, tgt aug=false, |Θ|=3x2022.0440.35
Data Diversesrc aug=true, tgt aug=true, |Θ|=7x2022.0439.58
FAASTBackbone=Qwen2.5-3B-Instruct, Protocol=FAAST, Data Setting=1-shot2026.0539.46
CipherDAug - 1 keysrc aug=false, tgt aug=false, |Θ|=2x2022.0439.45
BPE-dropoutSegmentation=BPE-dropout2019.1039.39
BPE-Dropoutsrc aug=true, tgt aug=true, |Θ|=1x2022.0439.39
Qwen2.5-3B-InstructBackbone=Qwen2.5-3B-Instruct, Protocol=zero-shot, Data Setting=full2026.0539.24
Kudo (2018)Segmentation=Unigram Language Model2019.1038.88
RAML+SwitchOutsrc aug=true, tgt aug=true, |Θ|=1x2022.0438.85
In-Context LearningBackbone=Qwen2.5-3B-Instruct, Protocol=In-Context Learning, Data Setting=1-shot2026.0538.51
RAMLsrc aug=false, tgt aug=true, |Θ|=1x2022.0438.38
SwitchOutsrc aug=true, tgt aug=false, |Θ|=1x2022.0438.2
BPESegmentation=BPE2019.1038.18
Transformersrc aug=false, tgt aug=false, |Θ|=1x2022.0438.18
LABOModel=Transformer2023.0537.2
LSModel=Transformer2023.0536.8
TransformerModel=Transformer2023.0535.4