Summarization on WikiLingua GEM (test)
10.4ROUGE-2GLM-130B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GLM-130BShot-setting=1-shot, Attention mechanism=bidirectional (bi)2022.10 | 10.4 | 23.4 | 45 | |
| PaLM-540BShot-setting=1-shot, Number of parameters=540B2022.10 | 9.9 | 20.6 | 47.7 | |
| GPT-3 175B (Davinci)Shot-setting=1-shot, Number of parameters=175B2022.10 | 7.2 | 18.9 | 41.2 | |
| GLM-130BShot-setting=1-shot, Attention mechanism=unidirectional (uni)2022.10 | 5.8 | 16.4 | 39.4 | |
| LaMDA 137BShot-setting=1-shot, Number of parameters=137B2022.10 | 5.4 | — | — |