Summarization on XLSum (test)
88QualityReference
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Reference2022.12 | 88 | 31 | 27 | 1 | — | — | |
| mT5 (Filtered)variant=Filtered, selection_criterion=Best-NLI2022.12 | 86 | 52 | 45 | 0.87 | 32.98 | 76.5 | |
| mT5 (Controlled)variant=Controlled, selection_criterion=Best-NLI2022.12 | 86 | 47 | 40 | 0.81 | 33.28 | 71.38 | |
| mT5 (Vanilla)variant=Vanilla, selection_criterion=Best-ROUGE2022.12 | 85 | 44 | 37 | 0.93 | 33.65 | 64.31 | |
| mT5 (Filtered)variant=Filtered, selection_criterion=Best-ROUGE2022.12 | 85 | 46 | 39 | 0.89 | 34 | 72.18 | |
| mT5 (Vanilla)variant=Vanilla, selection_criterion=Best-NLI2022.12 | 84 | 47 | 40 | 0.88 | 33.18 | 67.82 | |
| mT5 (Controlled)variant=Controlled, selection_criterion=Best-ROUGE2022.12 | 84 | 49 | 41 | 1 | 33.02 | 72.18 |