Summarization on WikiLingua GEM en -> en (test)
23.8ROUGE-2 ScoreT5
Evaluation results
| Method | Links | |
|---|---|---|
| T5Model Scale=XXL, Evaluation Protocol=Finetuning2022.04 | 23.8 | |
| PaLMModel Scale=540B, Evaluation Protocol=Finetuning2022.04 | 23.2 | |
| PaLMModel Scale=62B, Evaluation Protocol=Finetuning2022.04 | 22.1 | |
| PaLMModel Scale=8B, Evaluation Protocol=Finetuning2022.04 | 19.3 | |
| PaLMModel Scale=540B, Evaluation Protocol=1-shot2022.04 | 9.9 | |
| PaLMModel Scale=62B, Evaluation Protocol=1-shot2022.04 | 8.9 | |
| PaLMModel Scale=8B, Evaluation Protocol=1-shot2022.04 | 5.6 | |
| LaMDAModel Scale=137B, Evaluation Protocol=1-shot2022.04 | 5.4 |