Summarization on GEM XSum en
23.2ROUGE-2PEGASUS
Evaluation results
| Method | Links | |
|---|---|---|
| PEGASUSEvaluation Protocol=Finetuning2022.04 | 23.2 | |
| PaLMModel Scale=540B, Evaluation Protocol=Finetuning2022.04 | 21.2 | |
| T5Model Scale=XXL, Evaluation Protocol=Finetuning2022.04 | 21 | |
| PaLMModel Scale=62B, Evaluation Protocol=Finetuning2022.04 | 18.5 | |
| PaLMModel Scale=8B, Evaluation Protocol=Finetuning2022.04 | 16.3 | |
| PaLMModel Scale=540B, Evaluation Protocol=1-shot2022.04 | 12.2 | |
| PaLMModel Scale=62B, Evaluation Protocol=1-shot2022.04 | 11.2 | |
| PaLMModel Scale=8B, Evaluation Protocol=1-shot2022.04 | 7.9 | |
| LaMDAModel Scale=137B, Evaluation Protocol=1-shot2022.04 | 5.4 |