Semantic Parsing on PMB v.2.1.0 (test)
82.7F1van Noord et al. (2018)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| van Noord et al. (2018)Training Data=gold and silver standard data combined, Conversion #sents=73,778, Conversion score=100%2019.09 | 82.7 | — | — | 1.1 | |
| seq2graphTraining Data=gold and silver standard data combined, Conversion #sents=56,694, Conversion score=89.58%2019.09 | 77.1 | — | — | 0.9 | |
| seq2seq + copyTraining Data=gold and silver standard data combined, Conversion #sents=56,694, Conversion score=89.58%2019.09 | 74.67 | — | — | 13.45 | |
| seq2graphTraining Data=gold standard2019.09 | 73.55 | 75.51 | 71.69 | 0.4 | |
| van Noord et al. (2018)Training Data=gold standard2019.09 | 72.8 | — | — | 2 | |
| seq2seq + copyTraining Data=gold standard2019.09 | 71.18 | 75.57 | 67.27 | 4.12 |