Semantic Role Labeling on CoNLL WSJ 2005 (test)
87.13PrecisionLISA
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LISAEmbeddings=ELMo, Parses=D&M2018.04 | 87.13 | 86.67 | 86.9 | — | |
| LISAEmbeddings=ELMo, Parses=LISA predicted2018.04 | 86.69 | 86.42 | 86.55 | — | |
| SAEmbeddings=ELMo, Parses=None2018.04 | 86.21 | 85.98 | 86.09 | — | |
| LISAEmbeddings=GloVe, Predicates=Gold, Parser=D&M parses2018.04 | 86.02 | 86.05 | 86.04 | — | |
| DEEPATTArchitecture=FFN, Ensemble=true2017.12 | 85.9 | 86.3 | 86.1 | 69 | |
| LISAEmbeddings=GloVe, Parses=D&M2018.04 | 85.53 | 84.45 | 84.99 | — | |
| He et al.Ensemble=true2017.12 | 85 | 84.3 | 84.6 | 66.5 | |
| Span-based SRL (Ours)Embeddings=ELMo, Evaluation Protocol=End-to-End2018.05 | 84.8 | 87.2 | 86 | — | |
| He et al. (2018)Embeddings=ELMo2018.04 | 84.8 | 87.2 | 86 | — | |
| LISAEmbeddings=GloVe, Predicates=Gold, Parser=LISA parses2018.04 | 84.72 | 84.57 | 84.64 | — | |
| SAEmbeddings=GloVe, Predicates=Gold, Parser=None (syntax-free)2018.04 | 84.7 | 84.24 | 84.47 | — | |
| DEEPATTArchitecture=FFN, Ensemble=false2017.12 | 84.5 | 85.2 | 84.8 | 66.4 | |
| Tan et al. (2018)Embeddings=GloVe, Predicates=Gold2018.04 | 84.5 | 85.2 | 84.8 | — | |
| He et al. (2018)Embeddings=GloVe, Predicates=Gold2018.04 | 84.2 | 83.7 | 83.9 | — | |
| SAEmbeddings=GloVe, Parses=None2018.04 | 84.17 | 83.28 | 83.72 | — | |
| LISAEmbeddings=GloVe, Parses=LISA predicted2018.04 | 84.07 | 83.16 | 83.61 | — | |
| DEEPATTArchitecture=CNN, Ensemble=false2017.12 | 83.6 | 83.9 | 83.8 | 65.4 | |
| DEEPATTArchitecture=RNN, Ensemble=false2017.12 | 83.5 | 84 | 83.7 | 65.2 | |
| He et al.Ensemble=false2017.12 | 83.1 | 83 | 83.1 | 64.3 | |
| Zhou and Xu2017.12 | 82.9 | 82.8 | 82.8 | — | |
| FitzGerald et al.Architecture=Struct., Ensemble=true2017.12 | 82.5 | 78.2 | 80.3 | 57.3 | |
| Tackström et al.Architecture=Struct., Ensemble=false2017.12 | 82.3 | 77.6 | 79.9 | 56 | |
| Punyakanok et al.Ensemble=true2017.12 | 82.3 | 76.8 | 79.4 | 53.8 | |
| He et al. (2017)Model Variant=Product of Experts (POE), Evaluation Protocol=End-to-End2018.05 | 82 | 83.4 | 82.7 | — | |
| He et al. (2017) PoEEmbeddings=GloVe2018.04 | 82 | 83.4 | 82.7 | — | |
| Toutanova et al.Ensemble=true2017.12 | 81.9 | 78.8 | 80.3 | 60.1 | |
| Span-based SRL (Ours)Embeddings=GloVe, Evaluation Protocol=End-to-End2018.05 | 81.2 | 83.9 | 82.5 | — | |
| He et al. (2018)Embeddings=GloVe2018.04 | 81.2 | 83.9 | 82.5 | — | |
| He et al. (2017)Evaluation Protocol=End-to-End2018.05 | 80.2 | 82.3 | 81.2 | — |