Summarization on GEM WikiLingua es -> en
20.9ROUGE-2PaLM
Evaluation results
| Method | Links | |
|---|---|---|
| PaLMModel Scale=540B, Evaluation Protocol=Finetuning2022.04 | 20.9 | |
| Gehrmann et al.Evaluation Protocol=Finetuning2022.04 | 18.3 | |
| PaLMModel Scale=62B, Evaluation Protocol=Finetuning2022.04 | 18.2 | |
| T5Model Scale=XXL, Evaluation Protocol=Finetuning2022.04 | 17.9 | |
| PaLMModel Scale=8B, Evaluation Protocol=Finetuning2022.04 | 16.1 | |
| PaLMModel Scale=540B, Evaluation Protocol=1-shot2022.04 | 7.7 | |
| PaLMModel Scale=62B, Evaluation Protocol=1-shot2022.04 | 5.8 | |
| PaLMModel Scale=8B, Evaluation Protocol=1-shot2022.04 | 3.4 | |
| LaMDAModel Scale=137B, Evaluation Protocol=1-shot2022.04 | 2.2 |