Semantic Role Labeling on CoNLL 2005 (dev)
87.63F1 ScoreLISA
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| LISAEmbeddings=ELMo, Parses=Gold2018.04 | 87.63 | 88.51 | 86.77 | — | — | |
| LISAEmbeddings=GloVe, Parses=Gold2018.04 | 86.81 | 87.91 | 85.73 | — | — | |
| LISAEmbeddings=ELMo, Parses=LISA predicted2018.04 | 85.35 | 86.07 | 84.64 | — | — | |
| He et al. (2018)Embeddings=ELMo2018.04 | 85.3 | 84.9 | 85.7 | — | — | |
| SAEmbeddings=ELMo, Parses=None2018.04 | 85.26 | 85.78 | 84.74 | — | — | |
| LISAEmbeddings=ELMo, Parses=D&M2018.04 | 85.17 | 85.83 | 84.51 | — | — | |
| LISAEmbeddings=GloVe, Parses=D&M2018.04 | 83.58 | 84.59 | 82.59 | — | — | |
| SAEmbeddings=GloVe, Parses=None2018.04 | 82.39 | 83.52 | 81.28 | — | — | |
| LISAEmbeddings=GloVe, Parses=LISA predicted2018.04 | 82.24 | 83.1 | 81.39 | — | — | |
| He et al. (2018)Embeddings=GloVe2018.04 | 81.6 | 81.3 | 81.9 | — | — | |
| He et al. (2017) PoEEmbeddings=GloVe2018.04 | 81.5 | 81.8 | 81.2 | — | — | |
| DEEPATTArchitecture=FFN, Ensemble=true2017.12 | 0.846 | 0.843 | 0.849 | 0.673 | — | |
| DEEPATTArchitecture=FFN, Ensemble=false2017.12 | 0.831 | 0.826 | 0.836 | 0.652 | — | |
| He et al.Ensemble=true2017.12 | 0.827 | 0.831 | 0.824 | 0.641 | — | |
| DEEPATTArchitecture=CNN, Ensemble=false2017.12 | 0.824 | 0.821 | 0.828 | 0.636 | — | |
| DEEPATTArchitecture=RNN, Ensemble=false2017.12 | 0.818 | 0.812 | 0.823 | 0.624 | — | |
| He et al.Ensemble=false2017.12 | 0.816 | 0.816 | 0.816 | 0.623 | — | |
| Zhou and Xu2017.12 | 0.796 | 0.797 | 0.794 | — | — | |
| FitzGerald et al.Architecture=Struct., Ensemble=true2017.12 | 0.789 | 0.812 | 0.767 | 0.551 | — | |
| Tackström et al.Architecture=Struct., Ensemble=false2017.12 | 0.786 | 0.812 | 0.762 | 0.544 | — | |
| Toutanova et al.Ensemble=true2017.12 | 0.786 | — | — | 0.587 | — | |
| Punyakanok et al.Ensemble=true2017.12 | 0.774 | 0.801 | 0.748 | 0.507 | — | |
| DEEPATTEvaluation Protocol=given gold spans2017.12 | — | — | — | — | 88.88 | |
| He et al.Evaluation Protocol=given gold spans2017.12 | — | — | — | — | 87.1 |