Cross-lingual Summarization on WikiLingua
18.6ROUGE-2 (ru->en)PaLM540B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| PaLM540BModel Size=540B, #Training Tokens=500B2022.08 | 18.6 | 19.1 | 20.9 | 23.1 | 20.4 | |
| Z-Code++LARGEModel Size=710M, #Training Tokens=500B2022.08 | 15.9 | 16.7 | 17.7 | 22.9 | 18.3 | |
| mT5-XLARGEModel Size=3B, #Training Tokens=1T2022.08 | 14.6 | 14.9 | 17.2 | 18.3 | 16.3 | |
| mT5-LARGEModel Size=705M, #Training Tokens=1T2022.08 | 11.2 | 10.9 | 12.6 | 14.5 | 12.3 |