Cross-lingual Summarization on En2ZhSum (test)
46.87ROUGE-12-Step
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| 2-StepMethodology=Source summary guidance2023.07 | 46.87 | 24.48 | 39.92 | 0.791 | — | — | — | |
| S-TMethodology=Pipeline (Summarization and Translation)2023.07 | 46.32 | 24.08 | 39.51 | 0.7836 | — | — | — | |
| NCLSScenario=Full dataset2021.05 | 44.16 | 24.28 | 30.23 | 0.7407 | — | — | — | |
| NCLS+MSScenario=Full dataset2021.05 | 42.68 | 23.51 | 29.24 | 0.7361 | — | — | — | |
| MCLASScenario=Full dataset2021.05 | 42.27 | 24.6 | 30.09 | 0.7069 | — | — | — | |
| VHMinitialization=mBART weights2022.03 | 41.95 | 23.54 | 37.67 | — | — | — | — | |
| MLPT2022.03 | 41.62 | 23.35 | 37.26 | — | — | — | — | |
| mBART2022.03 | 41.55 | 23.27 | 37.22 | — | — | — | — | |
| E2EMethodology=End2End2023.07 | 41.33 | 20.14 | 34.74 | 0.7666 | — | — | — | |
| VHM2022.03 | 40.98 | 23.07 | 37.12 | — | — | — | — | |
| ATS-A2022.03 | 40.47 | 22.21 | 36.89 | — | — | — | — | |
| MT-MS-CLS2022.03 | 40.34 | 22.35 | 36.44 | — | — | — | — | |
| MT-CLS2022.03 | 40.23 | 22.32 | 36.59 | — | — | — | — | |
| NCLSScenario=Maximum Low-resource2021.05 | 40.18 | 19.86 | 26.52 | 0.7435 | — | — | — | |
| MT-CLSsource=released code2022.03 | 40.14 | 22.36 | 36.45 | — | — | — | — | |
| NCLS+MSScenario=Maximum Low-resource2021.05 | 39.86 | 19.87 | 26.64 | 0.7445 | — | — | — | |
| E2MMethodology=End2End Multi-task2023.07 | 39.12 | 18.94 | 33.7 | 0.7545 | — | — | — | |
| NCLS+MSScenario=Medium Low-resource2021.05 | 38.95 | 18.09 | 25.39 | 0.7172 | — | — | — | |
| MCLASScenario=Maximum Low-resource2021.05 | 38.35 | 19.75 | 26.41 | 0.6921 | — | — | — | |
| MS-CLSsource=released code2022.03 | 38.26 | 20.07 | 34.49 | — | — | — | — | |
| MS-CLS2022.03 | 38.25 | 20.2 | 34.76 | — | — | — | — | |
| MS-CLS-Rec2022.03 | 38.12 | 16.76 | 33.86 | — | — | — | — | |
| MCLASScenario=Medium Low-resource2021.05 | 37.28 | 18.1 | 25.26 | 0.6839 | — | — | — | |
| TNCLS2022.03 | 36.82 | 18.72 | 33.2 | — | — | — | — | |
| NCLSScenario=Medium Low-resource2021.05 | 35.98 | 15.88 | 23.79 | 0.7298 | — | — | — | |
| NCLSScenario=Minimum Low-resource2021.05 | 34.14 | 12.45 | 21.2 | 0.7096 | — | — | — | |
| NCLS+MSScenario=Minimum Low-resource2021.05 | 33.96 | 12.38 | 21.07 | 0.7102 | — | — | — | |
| GLTran2022.03 | 32.17 | 13.85 | 29.43 | — | — | — | — | |
| MCLASScenario=Minimum Low-resource2021.05 | 32.03 | 13.17 | 21.17 | 0.6529 | — | — | — | |
| TLTranScenario=Full dataset2021.05 | 30.2 | 12.2 | 27.02 | — | — | — | — | |
| GETran2022.03 | 28.19 | 11.4 | 25.77 | — | — | — | — | |
| ATS-ASetting=Full setting2022.03 | — | — | — | — | 3.12 | 3.31 | 3.28 | |
| MS-CLSSetting=Full setting2022.03 | — | — | — | — | 3.04 | 3.22 | 3.12 | |
| MT-CLSSetting=Full setting2022.03 | — | — | — | — | 3.18 | 3.46 | 3.36 | |
| MT-MS-CLSSetting=Full setting2022.03 | — | — | — | — | 3.24 | 3.48 | 3.42 | |
| VHMSetting=Full setting2022.03 | — | — | — | — | 3.36 | 3.54 | 3.48 |