Dependency-based Semantic Role Labeling on CoNLL Brown 2009 (test)
88.27PrecisionSynG2G-Tr+Gold
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SynG2G-Tr+GoldSA (Syntax-Aware)=true, Setting=gold syntax2021.04 | 88.27 | 88.31 | 88.29 | |
| SynG2G-TrSA (Syntax-Aware)=true, Setting=given predicate, Initialisation=BERT2021.04 | 86.4 | 86.47 | 86.43 | |
| He et al. (2019)SA (Syntax-Aware)=true, Setting=given predicate, Initialisation=BERT2021.04 | 86.15 | 86.7 | 86.42 | |
| Fei et al. (2021)SA (Syntax-Aware)=true, Setting=gold syntax2021.04 | 85.6 | 85.3 | 85.4 | |
| Munir et al. (2021)SA (Syntax-Aware)=true, Setting=given predicate, Initialisation=BERT2021.04 | 83.1 | 82.6 | 82.8 | |
| Chen et al. (2019)SA (Syntax-Aware)=false, Setting=given predicate, Initialisation=BERT2021.04 | 82.66 | 82.78 | 82.72 | |
| Lyu et al. (2019)SA (Syntax-Aware)=false, Setting=given predicate, Initialisation=BERT2021.04 | 82.18 | — | — | |
| Cai and Lapata (2019a)SA (Syntax-Aware)=true, Setting=given predicate, Initialisation=BERT2021.04 | 82.1 | 81.3 | 81.6 | |
| He et al. (2018b)SA (Syntax-Aware)=true, Setting=given predicate, Initialisation=w/o BERT2021.04 | 81.9 | 76.9 | 79.3 | |
| Li et al. (2019)SA (Syntax-Aware)=false, Setting=given predicate, Initialisation=BERT2021.04 | 81.7 | 81.4 | 81.5 | |
| SynG2G-TrSA (Syntax-Aware)=true, Setting=end-to-end, Initialisation=BERT2021.04 | 81.33 | 82.52 | 81.92 | |
| SynG2G-TrSA (Syntax-Aware)=true, Setting=given predicate, Initialisation=w/o BERT2021.04 | 81.32 | 82.15 | 81.73 | |
| Kasai et al. (2019)SA (Syntax-Aware)=true, Setting=given predicate, Initialisation=BERT2021.04 | 81 | 80.5 | 80.8 | |
| Cai and Lapata (2019c)SA (Syntax-Aware)=true, Setting=given predicate, Initialisation=w/o BERT2021.04 | 80.5 | 78.2 | 79.4 | |
| Li et al. (2019)SA (Syntax-Aware)=true, Setting=end-to-end, Initialisation=BERT2021.04 | 80.35 | 83.57 | 81.93 | |
| Cai et al. (2018)SA (Syntax-Aware)=false, Setting=given predicate, Initialisation=w/o BERT2021.04 | 79.8 | 78.3 | 79 | |
| Marcheggiani et al. (2017)SA (Syntax-Aware)=false, Setting=given predicate, Initialisation=w/o BERT2021.04 | 79.4 | 76.2 | 77.7 | |
| M&T(2017)SA (Syntax-Aware)=true, Setting=given predicate, Initialisation=w/o BERT2021.04 | 78.5 | 75.9 | 77.2 | |
| Kasai et al. (2019)SA (Syntax-Aware)=true, Setting=given predicate, Initialisation=w/o BERT2021.04 | 77.2 | 77.6 | 77.4 | |
| SynG2G-TrSA (Syntax-Aware)=true, Setting=end-to-end, Initialisation=w/o BERT2021.04 | 74.6 | 73.8 | 74.2 | |
| Li et al. (2019)SA (Syntax-Aware)=true, Setting=end-to-end, Initialisation=w/o BERT2021.04 | 73.66 | 72.56 | 73.11 | |
| He et al. (2018b)SA (Syntax-Aware)=false, Setting=end-to-end, Initialisation=w/o BERT2021.04 | 72.5 | — | — |