AMR-to-text on LDC2017T10 (test)
74.79chrF++T5-large + STA (2M)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| T5-large + STA (2M)Backbone=T5-large, Task-adaptive pretraining=STA, Pretraining samples=2M2020.07 | 74.79 | 96.59 | 69.53 | |
| T5-large + STA (200K)Backbone=T5-large, Task-adaptive pretraining=STA, Pretraining samples=200K2020.07 | 74.09 | 96.51 | 68.86 | |
| BART-large + STA (2M)Backbone=BART-large, Task-adaptive pretraining=STA, Pretraining samples=2M2020.07 | 73.58 | 96.43 | 68.14 | |
| T5-large + LMABackbone=T5-large, Task-adaptive pretraining=LMA2020.07 | 72.83 | 96.32 | 67.44 | |
| T5-largeBackbone=T5-large2020.07 | 72.57 | 96.27 | 67.37 | |
| BART-large + STA (200K)Backbone=BART-large, Task-adaptive pretraining=STA, Pretraining samples=200K2020.07 | 72.26 | 96.21 | 66.75 | |
| BART-large + LMABackbone=BART-large, Task-adaptive pretraining=LMA2020.07 | 71.14 | 95.94 | 64.75 | |
| BART-largeBackbone=BART-large2020.07 | 71.06 | 96.08 | 65.74 | |
| T5-baseBackbone=T5-base2020.07 | 70.81 | 95.99 | 65.63 | |
| T5-smallBackbone=T5-small2020.07 | 68.78 | 95.62 | 63.7 | |
| BART-baseBackbone=BART-base2020.07 | 66.65 | 95.22 | 60.78 | |
| Wang et al.2020.07 | 65.8 | — | — | |
| Yao et al.2020.07 | 65.6 | — | — | |
| Zhu et al.2020.07 | 64.05 | — | — | |
| Mager et al.type=based on PLMs2020.07 | 63.89 | — | — | |
| Cai and Lam2020.07 | 59.4 | — | — | |
| Guo et al.2020.07 | 57.3 | — | — |