Cross-lingual Text Generation on WikiLingua (test)
23.5ROUGE-2PaLM 2-L
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| PaLM 2-Lshot=1-shot, languages=ar, ja, ko, ru, th, tr, decoding=greedy, prompt=Custom 1-shot prompt2023.05 | 23.5 | — | — | — | — | — | |
| PaLM 2-Mshot=1-shot, languages=ar, ja, ko, ru, th, tr, decoding=greedy, prompt=Custom 1-shot prompt2023.05 | 17.6 | — | — | — | — | — | |
| PaLM 2-Sshot=1-shot, languages=ar, ja, ko, ru, th, tr, decoding=greedy, prompt=Custom 1-shot prompt2023.05 | 16.8 | — | — | — | — | — | |
| PaLMshot=1-shot, languages=ar, ja, ko, ru, th, tr, decoding=greedy, prompt=Custom 1-shot prompt2023.05 | 11.7 | — | — | — | — | — | |
| cos-simModel Selection Criterion=Similarity of representations (cos-sim/XLRS)2023.05 | — | 25.3 | 21.2 | 24.6 | 26.5 | -0.85 | |
| en-devModel Selection Criterion=English development set (en-dev)2023.05 | — | 23.5 | 19.8 | 22.4 | 22.4 | -3.23 | |
| tgt-devModel Selection Criterion=Target language development set (tgt-dev)2023.05 | — | 25.4 | 21.9 | 25.4 | 28.3 | 0 |