Summarization on GEM WikiLingua vi -> en
19.1ROUGE-2PaLM
Evaluation results
| Method | Links | |
|---|---|---|
| PaLMModel Scale=540B, Evaluation Protocol=Finetuning2022.04 | 19.1 | |
| PaLMModel Scale=62B, Evaluation Protocol=Finetuning2022.04 | 16.3 | |
| mT5Evaluation Protocol=Finetuning2022.04 | 14.9 | |
| PaLMModel Scale=8B, Evaluation Protocol=Finetuning2022.04 | 13.4 | |
| T5Model Scale=XXL, Evaluation Protocol=Finetuning2022.04 | 9.7 | |
| PaLMModel Scale=540B, Evaluation Protocol=1-shot2022.04 | 5.5 | |
| PaLMModel Scale=62B, Evaluation Protocol=1-shot2022.04 | 4 | |
| PaLMModel Scale=8B, Evaluation Protocol=1-shot2022.04 | 1.5 | |
| LaMDAModel Scale=137B, Evaluation Protocol=1-shot2022.04 | 0.3 |