Dependency Semantic Role Labeling on CoNLL 2009 (test)
93.03F1 ScoreSynG2G-Tr+Gold
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SynG2G-Tr+GoldSA (Syntax-Aware)=true, Setting=gold syntax2021.04 | 93.03 | 92.71 | 93.37 | |
| Fei et al. (2021)SA (Syntax-Aware)=true, Setting=gold syntax2021.04 | 92.5 | 92.5 | 92.5 | |
| SynG2G-TrSA (Syntax-Aware)=true, Setting=given predicate, Initialisation=BERT2021.04 | 91.23 | 91.31 | 91.16 | |
| Chen et al. (2019)SA (Syntax-Aware)=false, Setting=given predicate, Initialisation=BERT2021.04 | 91.06 | 90.74 | 91.38 | |
| Munir et al. (2021)SA (Syntax-Aware)=true, Setting=given predicate, Initialisation=BERT2021.04 | 90.9 | 91.2 | 90.6 | |
| He et al. (2019)SA (Syntax-Aware)=true, Setting=given predicate, Initialisation=BERT2021.04 | 90.86 | 90.41 | 91.32 | |
| Cai and Lapata (2019a)SA (Syntax-Aware)=true, Setting=given predicate, Initialisation=BERT2021.04 | 90.7 | 91.1 | 90.4 | |
| Li et al. (b) AAAI (ELMo+biaffine)Syntax-aware=false, Sequence tagging=false, Architecture=ELMo+biaffine, Year=20192019.01 | 90.4 | — | — | |
| Li et al. (2019)SA (Syntax-Aware)=false, Setting=given predicate, Initialisation=BERT2021.04 | 90.4 | 89.6 | 91.2 | |
| Kasai et al. (2019)SA (Syntax-Aware)=true, Setting=given predicate, Initialisation=BERT2021.04 | 90.2 | 90.3 | 90 | |
| SynG2G-TrSA (Syntax-Aware)=true, Setting=given predicate, Initialisation=w/o BERT2021.04 | 90.03 | 89.78 | 90.28 | |
| Li et al. (a) (ELMo)Syntax-aware=true, Sequence tagging=true, Architecture=ELMo, Year=20182019.01 | 89.8 | — | — | |
| Cai et al. (biaffine)Syntax-aware=false, Sequence tagging=false, Architecture=biaffine, Year=20182019.01 | 89.6 | — | — | |
| Cai et al. (2018)SA (Syntax-Aware)=false, Setting=given predicate, Initialisation=w/o BERT2021.04 | 89.6 | 89.9 | 89.2 | |
| Cai and Lapata (2019c)SA (Syntax-Aware)=true, Setting=given predicate, Initialisation=w/o BERT2021.04 | 89.6 | 90.5 | 88.6 | |
| He et al. (b) (ELMo)Syntax-aware=true, Sequence tagging=true, Architecture=ELMo, Year=20182019.01 | 89.5 | — | — | |
| He et al. (2018b)SA (Syntax-Aware)=true, Setting=given predicate, Initialisation=w/o BERT2021.04 | 89.5 | 89.7 | 89.3 | |
| Kasai et al. (2019)SA (Syntax-Aware)=true, Setting=given predicate, Initialisation=w/o BERT2021.04 | 88.6 | 89 | 88.2 | |
| Li et al. (2019)SA (Syntax-Aware)=true, Setting=end-to-end, Initialisation=BERT2021.04 | 88.05 | 86.38 | 89.78 | |
| Marcheggiani and Titov (GCNs)Syntax-aware=true, Sequence tagging=true, Architecture=GCNs, Year=20172019.01 | 88 | — | — | |
| M&T(2017)SA (Syntax-Aware)=true, Setting=given predicate, Initialisation=w/o BERT2021.04 | 88 | 89.1 | 86.8 | |
| Roth and Lapata (PathLSTM)Syntax-aware=true, Sequence tagging=false, Architecture=PathLSTM, Year=20162019.01 | 87.7 | — | — | |
| Marcheggiani et al. (BiLSTM)Syntax-aware=true, Sequence tagging=false, Architecture=BiLSTM, Year=20172019.01 | 87.7 | — | — | |
| SynG2G-TrSA (Syntax-Aware)=true, Setting=end-to-end, Initialisation=BERT2021.04 | 87.7 | 88.7 | 86.8 | |
| Marcheggiani et al. (2017)SA (Syntax-Aware)=false, Setting=given predicate, Initialisation=w/o BERT2021.04 | 87.7 | 88.7 | 86.8 | |
| Björkelund et al. (structured)Syntax-aware=true, Sequence tagging=false, Architecture=structured, Year=20102019.01 | 87.3 | — | — | |
| Björkelund et al. (global)Syntax-aware=true, Sequence tagging=false, Architecture=global, Year=20102019.01 | 86.9 | — | — | |
| Zhao et al. (ME)Syntax-aware=true, Sequence tagging=false, Architecture=ME, Year=20092019.01 | 86.2 | — | — | |
| Li et al. (2019)SA (Syntax-Aware)=true, Setting=end-to-end, Initialisation=w/o BERT2021.04 | 85.59 | 84.1 | 87.07 | |
| SynG2G-TrSA (Syntax-Aware)=true, Setting=end-to-end, Initialisation=w/o BERT2021.04 | 85.3 | 84.5 | 86.1 | |
| Cai et al. (2018)SA (Syntax-Aware)=false, Setting=end-to-end, Initialisation=w/o BERT2021.04 | 85 | 84.7 | 85.2 | |
| He et al. (2018b)SA (Syntax-Aware)=false, Setting=end-to-end, Initialisation=w/o BERT2021.04 | 83.3 | 83.9 | 82.7 | |
| Lyu et al. (2019)SA (Syntax-Aware)=false, Setting=given predicate, Initialisation=BERT2021.04 | — | 90.99 | — |