Machine Translation on human-collected unfaithful translation En ⇒ Zh (test)
19.1BLEUTarget-constrained tuning LoRA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Target-constrained tuning LoRASetting=Supervised, Adapter=LoRA2024.06 | 19.1 | 76.5 | |
| R-Drop tuning LORASetting=Supervised, Adapter=LoRA2024.06 | 18.7 | 76.5 | |
| Vanilla Instruction tuning LoRASetting=Supervised, Adapter=LoRA2024.06 | 18.6 | 76.2 | |
| Scheduled Sampling tuning LoRASetting=Supervised, Adapter=LoRA2024.06 | 18.6 | 76.1 | |
| Target-constrained tuningSetting=Supervised2024.06 | 17.9 | 75.2 | |
| Vanilla Instruction TuningSetting=Supervised2024.06 | 17.5 | 74.8 | |
| Vanilla FewshotSetting=Supervised2024.06 | 16.2 | 73.1 | |
| Reweight Attention (RA)Setting=Unsupervised2024.06 | 6.14 | 57 | |
| Contrastive Decoding (CD)Setting=Unsupervised2024.06 | 4.81 | 53.7 | |
| Vanilla ZeroshotSetting=Unsupervised2024.06 | 3.81 | 42.8 |