Summarization on GEM MLSum de
36.4ROUGE-2Gehrmann et al.
Evaluation results
| Method | Links | |
|---|---|---|
| Gehrmann et al.Evaluation Protocol=Finetuning2022.04 | 36.4 | |
| T5Model Scale=XXL, Evaluation Protocol=Finetuning2022.04 | 35.9 | |
| PaLMModel Scale=540B, Evaluation Protocol=Finetuning2022.04 | 33.1 | |
| PaLMModel Scale=62B, Evaluation Protocol=Finetuning2022.04 | 30 | |
| PaLMModel Scale=8B, Evaluation Protocol=Finetuning2022.04 | 26.5 | |
| PaLMModel Scale=540B, Evaluation Protocol=1-shot2022.04 | 12.8 | |
| PaLMModel Scale=62B, Evaluation Protocol=1-shot2022.04 | 10.5 | |
| PaLMModel Scale=8B, Evaluation Protocol=1-shot2022.04 | 4.6 | |
| LaMDAModel Scale=137B, Evaluation Protocol=1-shot2022.04 | 0.9 |