Machine Translation on human-collected unfaithful translation Zh ⇒ En (test)
16.6BLEUR-Drop tuning LORA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| R-Drop tuning LORASetting=Supervised, Adapter=LoRA2024.06 | 16.6 | 77.1 | |
| Target-constrained tuning LoRASetting=Supervised, Adapter=LoRA2024.06 | 16.6 | 77 | |
| Scheduled Sampling tuning LoRASetting=Supervised, Adapter=LoRA2024.06 | 16.5 | 76.8 | |
| Target-constrained tuningSetting=Supervised2024.06 | 16.1 | 77 | |
| Vanilla Instruction TuningSetting=Supervised2024.06 | 15.7 | 76.4 | |
| Vanilla Instruction tuning LoRASetting=Supervised, Adapter=LoRA2024.06 | 15.5 | 76.5 | |
| Vanilla FewshotSetting=Supervised2024.06 | 14.2 | 76.5 | |
| Reweight Attention (RA)Setting=Unsupervised2024.06 | 12.5 | 75 | |
| Contrastive Decoding (CD)Setting=Unsupervised2024.06 | 12.1 | 74.6 | |
| Vanilla ZeroshotSetting=Unsupervised2024.06 | 11.4 | 74.3 |