Semantic Role Labeling on CoNLL WSJ 2005 (dev)
89.25F1 ScoreLISA + Gold
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LISA + Goldpredicates=gold, syntax=Gold2018.04 | 89.25 | 89.11 | 89.38 | |
| Span-based SRLGold predicates=true, ELMo=true2018.05 | 87.4 | — | — | |
| Tan et al. (2018)Gold predicates=true, Product of Experts (POE)=true2018.05 | 86.1 | — | — | |
| Span-based SRL (Ours)Embeddings=ELMo, Evaluation Protocol=End-to-End2018.05 | 85.3 | — | — | |
| LISA + D&Mpredicates=gold, syntax=D&M2018.04 | 85.27 | 85.04 | 85.51 | |
| Tan et al. (2018)Gold predicates=true2018.05 | 84.8 | — | — | |
| He et al. (2017)Gold predicates=true, Product of Experts (POE)=true2018.05 | 84.6 | — | — | |
| Span-based SRLGold predicates=true, ELMo=false2018.05 | 83.9 | — | — | |
| He et al. (2018)predicates=gold2018.04 | 83.9 | 84.2 | 83.7 | |
| LISApredicates=gold, syntax=none2018.04 | 83.67 | 83.6 | 83.74 | |
| He et al. (2017)Gold predicates=true2018.05 | 83.1 | — | — | |
| Tan et al. (2018)predicates=gold2018.04 | 83.1 | 82.6 | 83.6 | |
| SApredicates=gold, syntax=none2018.04 | 82.97 | 83.12 | 82.81 | |
| Zhou and Xu (2015)Gold predicates=true2018.05 | 82.8 | — | — | |
| Yang and Mitchell (2017)Gold predicates=true2018.05 | 81.9 | — | — | |
| Span-based SRL (Ours)Embeddings=GloVe, Evaluation Protocol=End-to-End2018.05 | 81.6 | — | — | |
| He et al. (2017)Model Variant=Product of Experts (POE), Evaluation Protocol=End-to-End2018.05 | 81.5 | — | — | |
| He et al. (2017)Evaluation Protocol=End-to-End2018.05 | 80.3 | — | — | |
| FitzGerald et al. (2015)Gold predicates=true, Product of Experts (POE)=true2018.05 | 80.3 | — | — |