Summarization on WikiLingua tr -> en GEM (test)
23.1ROUGE-2PaLM
Evaluation results
| Method | Links | |
|---|---|---|
| PaLMModel Scale=540B, Evaluation Protocol=Finetuning2022.04 | 23.1 | |
| PaLMModel Scale=62B, Evaluation Protocol=Finetuning2022.04 | 21.4 | |
| mT5Evaluation Protocol=Finetuning2022.04 | 18.3 | |
| PaLMModel Scale=8B, Evaluation Protocol=Finetuning2022.04 | 16.7 | |
| T5Model Scale=XXL, Evaluation Protocol=Finetuning2022.04 | 13.8 | |
| PaLMModel Scale=540B, Evaluation Protocol=1-shot2022.04 | 8.5 | |
| PaLMModel Scale=62B, Evaluation Protocol=1-shot2022.04 | 5.6 | |
| LaMDAModel Scale=137B, Evaluation Protocol=1-shot2022.04 | 1.8 | |
| PaLMModel Scale=8B, Evaluation Protocol=1-shot2022.04 | 1.8 |