Machine Translation on human-collected unfaithful translation En => De (test)
20.9BLEUTarget-constrained tuning
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Target-constrained tuningSetting=Supervised2024.06 | 20.9 | 78 | |
| Target-constrained tuning LoRASetting=Supervised, Adapter=LoRA2024.06 | 20.6 | 78.5 | |
| Vanilla Instruction tuning LoRASetting=Supervised, Adapter=LoRA2024.06 | 20.3 | 78.5 | |
| Scheduled Sampling tuning LoRASetting=Supervised, Adapter=LoRA2024.06 | 20.2 | 78.5 | |
| R-Drop tuning LORASetting=Supervised, Adapter=LoRA2024.06 | 20.1 | 78.8 | |
| Vanilla Instruction TuningSetting=Supervised2024.06 | 19.8 | 77.5 | |
| Vanilla FewshotSetting=Supervised2024.06 | 15.7 | 74.2 | |
| Reweight Attention (RA)Setting=Unsupervised2024.06 | 10.6 | 63.3 | |
| Contrastive Decoding (CD)Setting=Unsupervised2024.06 | 9.1 | 61.5 | |
| Vanilla ZeroshotSetting=Unsupervised2024.06 | 7.11 | 60.6 |