Dependency-based Semantic Role Labeling on CoNLL 2009 (Out-of-domain (Brown))
87.2F1 ScoreMRC framework for SRL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MRC framework for SRLSyntax Dependency=agnostic, Backbone=RoBERTa2021.09 | 87.2 | 87.7 | 86.6 | |
| MRC framework for SRLSyntax Dependency=agnostic, Backbone=BERT2021.09 | 87 | 87.5 | 86.6 | |
| Chen et al.Syntax Dependency=aware, Backbone=BERT2021.09 | 86.3 | 87 | 86 | |
| Zhou et al.Syntax Dependency=aware, Backbone=BERT2021.09 | 85.9 | 85.7 | 86.1 | |
| Conia and NavigliSyntax Dependency=agnostic, Backbone=BERT2021.09 | 85.9 | — | — | |
| BERT-LSTM-largeArchitecture=Single2019.04 | 85.7 | 85.7 | 85.8 | |
| Shi and LinSyntax Dependency=agnostic, Backbone=BERT2021.09 | 85.7 | 85.7 | 85.8 | |
| BERT-LSTM-baseArchitecture=Single2019.04 | 85.1 | 85.6 | 84.7 | |
| Jindal et al.Syntax Dependency=agnostic, Backbone=BERT2021.09 | 85 | 83.5 | 86.5 | |
| Cai and LapataSyntax Dependency=aware2021.09 | 82.5 | 83.2 | 81.9 | |
| Li et al. (2019)Architecture=Single2019.04 | 81.5 | 81.7 | 81.4 | |
| Li et al.Syntax Dependency=agnostic2021.09 | 81.5 | 81.7 | 81.4 | |
| Kasai et al.Syntax Dependency=aware2021.09 | 80.8 | 81 | 80.5 | |
| Li et al. (2018)Architecture=Single2019.04 | 79.8 | 80.6 | 79 | |
| He et al. (2018b)Architecture=Single2019.04 | 79.3 | 81.9 | 76.9 | |
| Marcheggiani and Titov (2017)Architecture=Ensemble2019.04 | 78.9 | 80.8 | 77.1 | |
| Roth and Lapata (2016)Architecture=Ensemble2019.04 | 76.5 | 79.7 | 73.6 |