Informal to Formal Transfer on Italian GYAFC Equivalent (test)
48.5BLEUM3.1: EN data
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| M3.1: EN dataData Block=D3, Backbone=mBART2022.03 | 48.5 | 67 | 56.3 | |
| M3.2: ADAPT + EN cross-attnData Block=D3, Backbone=mBART2022.03 | 48 | 67.2 | 56 | |
| M2.3: ADAPT + EN dataData Block=D2, Backbone=mBART2022.03 | 47.6 | 73.1 | 57.7 | |
| M2.2: ADAPT + EN cross-attnData Block=D2, Backbone=mBART2022.03 | 46.7 | 63.7 | 53.9 | |
| M1.2: M1.1 + EN dataData Block=D1, Backbone=mBART2022.03 | 46.1 | 84.1 | 59.6 | |
| M2.1: IBT training + EN dataData Block=D2, Backbone=mBART2022.03 | 46 | 51 | 48.4 | |
| M1.1: pseudo-parallel dataData Block=D1, Backbone=mBART2022.03 | 45.9 | 85.6 | 59.8 | |
| Rule-basedData Block=D42022.03 | 43.8 | 26.8 | 33.3 | |
| Multi-TaskData Block=D1, Backbone=mBART2022.03 | 42.6 | 72.7 | 53.7 | |
| M3.3: ADAPT + EN dataData Block=D3, Backbone=mBART2022.03 | 42.3 | 73.5 | 53.7 | |
| M4.2: ADAPT (generic data)Data Block=D4, Backbone=mBART2022.03 | 40.1 | 9.2 | 15 | |
| M4.1: original mBARTData Block=D4, Backbone=mBART2022.03 | 38 | 10.3 | 16.2 | |
| DLSMData Block=D2, Backbone=mBART2022.03 | 12.4 | 22.3 | 15.9 |