Summarization on WikiLingua Conventional Zero-Shot Directions
21.4RS Score (Fr->Hi)PISCES
Evaluation results
| Method | Links | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PISCESParameters=610M, Zero-shot evaluation=true2023.05 | 21.4 | 69.1 | 26.1 | 72.9 | 26.1 | 70.4 | 20.3 | 68.5 | 29.1 | 68.5 | 21.4 | 69 | 29.9 | 68.9 | 27 | 71 | 25.2 | 69.8 | |
| mBARTParameters=610M, Zero-shot evaluation=true2023.05 | 19.6 | 68.1 | 23.6 | 72.1 | 24 | 69.1 | 18.1 | 66.9 | 26.7 | 67.4 | 18.8 | 67.4 | 27.8 | 67.6 | 25 | 69.4 | 23 | 68.5 | |
| mT5Parameters=580M, Zero-shot evaluation=true2023.05 | 18.8 | 66.9 | 23 | 71.2 | 23.1 | 68.3 | 17.5 | 66.1 | 25.8 | 65.9 | 17.8 | 66.4 | 27.2 | 66.9 | 24.6 | 69.2 | 22.2 | 67.6 |