Constituency Parsing on WSJ Penn Treebank (test)
95.84F1 ScoreZhou and Zhao (2019)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Zhou and Zhao (2019)Pre-trained=BERT-Large (fine-tuned)2019.04 | 95.84 | — | — | — | |
| Multilingual Self-Attentive Parsermodel_configuration=ensemble of 42018.12 | 95.77 | 95.51 | 96.03 | — | |
| CNN LargeStacking method=fine-tune2019.03 | 95.6 | — | — | — | |
| Multilingual Self-Attentive Parsermodel_configuration=single model2018.12 | 95.59 | 95.46 | 95.73 | — | |
| Kitaev et al. (2019)Hardware=1x GPU, Pre-trained=BERT-Large (fine-tuned)2019.04 | 95.59 | — | — | 39 | |
| tetra-taggingHardware=1x TPU v3-8, Pre-trained=BERT-Large (fine-tuned)2019.04 | 95.44 | — | — | 1,200 | |
| CNN LargeStacking method=ELMo-style2019.03 | 95.2 | — | — | — | |
| Self-Attentive Encoder (ELMo)Model Type=Multi-model/External, Lexical representation=ELMo2018.05 | 95.13 | 94.85 | 95.4 | — | |
| Kitaev and Klein2018.12 | 95.13 | 94.85 | 95.4 | — | |
| ELMo BASE2019.03 | 95.1 | — | — | — | |
| Fried et al. (2017)Model Type=Multi-model/External2018.05 | 94.66 | — | — | — | |
| Fried et al.2018.12 | 94.66 | — | — | — | |
| Joshi et al.2018.12 | 94.3 | 93.8 | 94.8 | — | |
| Liu and Zhang (2017)Model Type=Multi-model/External2018.05 | 94.2 | — | — | — | |
| Liu and Zhang2018.12 | 94.2 | — | — | — | |
| Choe and Charniak (2016)Model Type=Multi-model/External2018.05 | 93.8 | — | — | — | |
| Choe and Charniak2018.12 | 93.8 | — | — | — | |
| Self-Attentive Encoder (CharLSTM)Model Type=Single model, WSJ only, Lexical representation=CharLSTM2018.05 | 93.55 | 93.2 | 93.9 | — | |
| Dyer et al. (2016)Model Type=Multi-model/External2018.05 | 93.3 | — | — | — | |
| Dyer et al.2018.12 | 93.3 | — | — | — | |
| Vinyals et al. (2015)Model Type=Multi-model/External2018.05 | 92.8 | — | — | — | |
| Stern et al. (2017b)Model Type=Single model, WSJ only2018.05 | 92.56 | 92.57 | 92.56 | — | |
| Gaddy et al. (2018)Model Type=Single model, WSJ only2018.05 | 92.08 | 91.76 | 92.41 | — | |
| Cross and Huang (2016)Model Type=Single model, WSJ only2018.05 | 91.3 | 90.5 | 92.1 | — | |
| Vilares et al. (2019)Hardware=1x GPU2019.04 | 91.13 | — | — | 942 | |
| Durrett and Klein (2015)Model Type=Multi-model/External2018.05 | 91.1 | — | — | — | |
| Vinyals et al. (2015)Model Type=Single model, WSJ only2018.05 | 88.3 | — | — | — |