Summarization on MLSUM German
36.4ROUGE-2SOTA
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SOTAEvaluation Protocol=Finetuning2022.08 | 36.4 | — | — | — | — | |
| T5 XXLEvaluation Protocol=Finetuning, Model Scale=XXL2022.08 | 35.9 | — | — | — | — | |
| AlexaTM 20BEvaluation Protocol=Finetuning, Model Scale=20B2022.08 | 33.73 | — | — | — | — | |
| PaLMEvaluation Protocol=Finetuning, Model Scale=540B2022.08 | 33.1 | — | — | — | — | |
| PaLMEvaluation Protocol=Finetuning, Model Scale=62B2022.08 | 30 | — | — | — | — | |
| AlexaTM 20BEvaluation Protocol=1-shot, Model Scale=20B2022.08 | 28.51 | — | — | — | — | |
| PaLMEvaluation Protocol=Finetuning, Model Scale=8B2022.08 | 26.5 | — | — | — | — | |
| PaLMEvaluation Protocol=1-shot, Model Scale=540B2022.08 | 12.8 | — | — | — | — | |
| PaLMEvaluation Protocol=1-shot, Model Scale=62B2022.08 | 10.5 | — | — | — | — | |
| PaLMEvaluation Protocol=1-shot, Model Scale=8B2022.08 | 4.6 | — | — | — | — | |
| NLSSum2022.04 | 0.32 | 0.28 | 0.2 | 0.2 | 2.32 | |
| XLMRSum2022.04 | 0.28 | 0.16 | 0.27 | 0.29 | 2.69 | |
| mBERTSum2022.04 | 0.25 | 0.07 | 0.31 | 0.37 | 2.98 | |
| Oracle2022.04 | 0.15 | 0.49 | 0.22 | 0.14 | 2.01 |