Graph-to-text generation on AGENDA (test)
25.66BLEUBARTlarge + STA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BARTlarge + STAtask-adaptive pretraining=STA, backbone=BART-large2020.07 | 25.66 | 25.74 | -8.97 | |
| BARTlarge + LMAtask-adaptive pretraining=LMA, backbone=BART-large2020.07 | 25.3 | 25.54 | -8.79 | |
| T5large + STAtask-adaptive pretraining=STA, backbone=T5-large2020.07 | 23.69 | 24.92 | -8.94 | |
| BARTlargetask-adaptive pretraining=none, backbone=BART-large2020.07 | 23.65 | 25.19 | -10.93 | |
| T5large + LMAtask-adaptive pretraining=LMA, backbone=T5-large2020.07 | 22.92 | 24.4 | -10.39 | |
| T5largetask-adaptive pretraining=none, backbone=T5-large2020.07 | 22.15 | 23.73 | -13.96 | |
| BARTbasetask-adaptive pretraining=none, backbone=BART-base2020.07 | 22.01 | 23.54 | -13.02 | |
| T5basetask-adaptive pretraining=none, backbone=T5-base2020.07 | 20.73 | 21.88 | -21.03 | |
| T5smalltask-adaptive pretraining=none, backbone=T5-small2020.07 | 20.22 | 21.62 | -24.1 | |
| Ribeiro et al.year=20202020.07 | 18.01 | 22.23 | — | |
| Schmitt et al.year=20202020.07 | 17.33 | 21.43 | — | |
| Anyear=20192020.07 | 15.1 | 19.5 | — | |
| Koncel et al.year=20192020.07 | 14.3 | 18.8 | — | |
| EntityWriterBeam size=42019.04 | 10.38 | 16.53 | — | |
| RewriterBeam size=4, Type=knowledge-agnostic2019.04 | 1.05 | 8.38 | — |