Summarization on GEM WikiLingua ru -> en
18.6ROUGE-2PaLM
Evaluation results
| Method | Links | |
|---|---|---|
| PaLMModel Scale=540B, Evaluation Protocol=Finetuning2022.04 | 18.6 | |
| PaLMModel Scale=62B, Evaluation Protocol=Finetuning2022.04 | 16.6 | |
| mT5Evaluation Protocol=Finetuning2022.04 | 14.6 | |
| PaLMModel Scale=8B, Evaluation Protocol=Finetuning2022.04 | 13.9 | |
| T5Model Scale=XXL, Evaluation Protocol=Finetuning2022.04 | 12.5 | |
| PaLMModel Scale=540B, Evaluation Protocol=1-shot2022.04 | 6.6 | |
| PaLMModel Scale=62B, Evaluation Protocol=1-shot2022.04 | 5.2 | |
| PaLMModel Scale=8B, Evaluation Protocol=1-shot2022.04 | 2.3 | |
| LaMDAModel Scale=137B, Evaluation Protocol=1-shot2022.04 | 0.1 |