KG-to-text generation on AGENDA (test)
51.63CHRF++BART-large + STA
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| BART-large + STABackbone=BART, Scale=large, Task-adaptive pretraining=Supervised Task Adaptation (STA)2020.07 | 51.63 | — | — | 89.27 | 34.28 | |
| BART-large + LMABackbone=BART, Scale=large, Task-adaptive pretraining=Language Model Adaptation (LMA)2020.07 | 51.33 | — | — | 89.12 | 33.42 | |
| BART-largeBackbone=BART, Scale=large, Task-adaptive pretraining=None2020.07 | 50.44 | — | — | 88.74 | 32.24 | |
| T5-large + STABackbone=T5, Scale=large, Task-adaptive pretraining=Supervised Task Adaptation (STA)2020.07 | 50.27 | — | — | 89.93 | 36.86 | |
| T5-large + LMABackbone=T5, Scale=large, Task-adaptive pretraining=Language Model Adaptation (LMA)2020.07 | 49.37 | — | — | 89.75 | 36.13 | |
| T5-baseBackbone=T5, Scale=base, Task-adaptive pretraining=None2020.07 | 48.14 | — | — | 88.81 | 31.33 | |
| T5-largeBackbone=T5, Scale=large, Task-adaptive pretraining=None2020.07 | 48.14 | — | — | 89.6 | 35.23 | |
| BART-baseBackbone=BART, Scale=base, Task-adaptive pretraining=None2020.07 | 48.02 | — | — | 89.36 | 34.33 | |
| CGE-LW#L=6, #H=8, 8, #P=69.8M2020.01 | 46.69 | 18.01 | 22.34 | — | — | |
| CGE-LWNumber of parameters=69.8M2020.06 | 46.69 | 18.01 | 22.34 | — | — | |
| CGE#L=6, 3, #H=8, 8, #P=61.5M2020.01 | 46.47 | 17.82 | 22.23 | — | — | |
| PGE#L=6, 3, #H=8, 8, #P=56.1M2020.01 | 46.41 | 17.55 | 22.02 | — | — | |
| Ribeiro et al.2020.07 | 46.37 | — | — | — | — | |
| PGE-LW#L=6, #H=8, 8, #P=69.0M2020.01 | 45.79 | 17.42 | 21.78 | — | — | |
| GraformerNumber of parameters=36.3M2020.06 | 45.43 | 17.8 | 22.07 | — | — | |
| T5-smallBackbone=T5, Scale=small, Task-adaptive pretraining=None2020.07 | 44.91 | — | — | 88.56 | 30.25 | |
| Local Encoder#L=3, #H=8, #P=54.0M2020.01 | 44.7 | 16.03 | 21.12 | — | — | |
| Schmitt et al.2020.07 | 44.53 | — | — | — | — | |
| Global Encoder#L=6, #H=8, #P=54.4M2020.01 | 43.95 | 15.44 | 20.76 | — | — | |
| GT2020.06 | — | 14.3 | 18.8 | — | — | |
| GT+RBS2020.06 | — | 15.1 | 19.5 | — | — | |
| Koncel-Kedziorski et al.#L=6, #H=82020.01 | — | 14.3 | 18.8 | — | — |