Summarization on WikiLingua Non-Trivial Zero-Shot Directions
20.2RS Score (Tr->En)PISCES
Evaluation results
| Method | Links | ||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PISCESParameters=610M, Zero-shot evaluation=true2023.05 | 20.2 | 68.2 | 19.6 | 68.9 | 15.7 | 64.9 | 21.2 | 66.7 | 22.9 | 64.9 | 19.9 | 66.7 | 3.1 | 53.8 | 2.8 | 53.4 | 3.7 | 52.9 | 3.2 | 53.4 | |
| mBARTParameters=610M, Zero-shot evaluation=true2023.05 | 10.6 | 62.1 | 10.8 | 64.4 | 9.9 | 60.1 | 13.5 | 60 | 15.2 | 59.9 | 12 | 61.3 | 2.1 | 49 | 2.1 | 49.2 | 2.1 | 48.4 | 2.1 | 48.4 | |
| mT5Parameters=580M, Zero-shot evaluation=true2023.05 | 9.5 | 61.6 | 10 | 63.8 | 7.8 | 59.1 | 12.6 | 59.6 | 14 | 59.6 | 10.8 | 60.7 | 2.2 | 48.9 | 2.1 | 48.8 | 2 | 48.2 | 2.1 | 48.4 |