Dependency Parsing on Penn Treebank (PTB) (test)
96.4LASHexatagger
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Hexataggerbackbone=XLNet2023.06 | 96.4 | 97.4 | |
| Mrini et al.2020.10 | 96.3 | 97.3 | |
| Mrini et al.extra constituency annotation=true2023.06 | 96.3 | 97.4 | |
| LAL-Parser2019.11 | 96.26 | 97.42 | |
| HPSG+LAAdditional Data=Constituency Parsing2021.05 | 96.26 | 97.42 | |
| Yang and Ture-implementation using same pretrained encoder=true2023.06 | 95.8 | 97.4 | |
| Joint Span HPSGstrategy=Joint, Pre-training=XLNet2019.07 | 95.72 | 97.2 | |
| Zhou and Zhaoyear=2019, backbone=XLNet2019.11 | 95.72 | 97.2 | |
| HPSGAdditional Data=Constituency Parsing2021.05 | 95.72 | 97.2 | |
| Ours-ProjBackbone=RoBERTa, Decoding Strategy=Projective2021.05 | 95.49 | 97.24 | |
| HiePTRBackbone=BERT2021.05 | 95.47 | 97.05 | |
| Ours-ProjBackbone=BERT, Decoding Strategy=Projective2021.05 | 95.46 | 97.18 | |
| Joint Span HPSGstrategy=Joint, Pre-training=BERT2019.07 | 95.43 | 97 | |
| Zhou and Zhaoyear=2019, backbone=BERT2019.11 | 95.43 | 97 | |
| Zhou and Zhaoextra constituency annotation=true2023.06 | 95.4 | 97 | |
| Ours-NprojBackbone=RoBERTa, Decoding Strategy=Non-projective2021.05 | 95.39 | 97.14 | |
| MP2OBackbone=RoBERTa2021.05 | 95.37 | 96.94 | |
| MulPTR+BERTAdditional Data=Constituency Parsing, Backbone=BERT2021.05 | 95.35 | 96.91 | |
| Ours-NprojBackbone=BERT, Decoding Strategy=Non-projective2021.05 | 95.35 | 97.09 | |
| MP2OBackbone=BERT2021.05 | 95.34 | 96.91 | |
| BiaffineBackbone=RoBERTa2021.05 | 95.34 | 96.87 | |
| BiaffineBackbone=BERT2021.05 | 95.29 | 96.78 | |
| Wang et al. (ELMo)Pre-training=ELMo2019.07 | 95.25 | 96.35 | |
| Wang et al.year=20182019.11 | 95.25 | 96.35 | |
| Clark et al.year=20182019.11 | 95.02 | 96.61 | |
| SynTr+RNGTrBackbone=BERT2021.05 | 95.01 | 96.66 | |
| Moh. and Hen.2020.10 | 95 | 96.7 | |
| Joint Span HPSGstrategy=Joint, Pre-training=ELMo2019.07 | 94.93 | 96.76 | |
| Ours-ProjBackbone=None, Decoding Strategy=Projective2021.05 | 94.71 | 96.42 | |
| Stack-Transformerattention_modification=1 head attends entire buffer2020.10 | 94.7 | 96.3 | |
| Stack-Transformerattention_modification=1 head attends stack, 1 head attends buffer2020.10 | 94.7 | 96.2 | |
| Joint Span HPSGstrategy=Joint2019.07 | 94.68 | 96.09 | |
| Kuncoro et al.type=ensemble2019.07 | 94.6 | 95.8 | |
| Kuncoro et al.year=20172019.11 | 94.6 | 95.8 | |
| Ours-NprojBackbone=None, Decoding Strategy=Non-projective2021.05 | 94.6 | 96.33 | |
| HiePTRBackbone=None2021.05 | 94.59 | 96.18 | |
| Division Span HPSGstrategy=Division, Pre-training=BERT2019.07 | 94.56 | 96.22 | |
| MulPTRAdditional Data=Constituency Parsing2021.05 | 94.5 | 96.06 | |
| CRF2OMBR decoding=false2020.05 | 94.49 | 96.14 | |
| TreeCRFBackbone=None2021.05 | 94.49 | 96.14 | |
| Loc2020.05 | 94.47 | 96.08 | |
| CRF2OMBR decoding=true2020.05 | 94.46 | 96.11 | |
| Pointer Networks2019.07 | 94.43 | 96.04 | |
| Fernández-González and Gómez-Rodríguezyear=20192019.11 | 94.43 | 96.04 | |
| LRPTRBackbone=None2021.05 | 94.43 | 96.04 | |
| F-Gonz. and G-Rodr.2020.10 | 94.4 | 96 | |
| Transformermulti-task=label top 100 SHIFT2020.10 | 94.4 | 96 | |
| CRFMBR decoding=false2020.05 | 94.34 | 96.04 | |
| CRFMBR decoding=true2020.05 | 94.33 | 96.02 | |
| Ji192020.05 | 94.31 | 95.97 | |
| Ji et al.year=20192019.11 | 94.31 | 95.97 | |
| Division Span HPSGstrategy=Division, Pre-training=ELMo2019.07 | 94.21 | 95.77 | |
| Ma et al.2019.07 | 94.19 | 95.87 | |
| Li192020.05 | 94.19 | 95.93 | |
| Ma et al.year=20182019.11 | 94.19 | 95.87 | |
| StackPTRBackbone=None2021.05 | 94.19 | 95.87 | |
| GNNBackbone=None2021.05 | 94.15 | 95.87 | |
| Choe and Charniak2019.07 | 94.1 | 95.9 | |
| Choe and Charniakyear=20162019.11 | 94.1 | 95.9 | |
| Dozat and Manning2023.06 | 94.1 | 95.7 | |
| Dozat and Manning2019.07 | 94.08 | 95.74 | |
| Biaffine172020.05 | 94.08 | 95.74 | |
| Dozat and Manningyear=20162019.11 | 94.08 | 95.74 | |
| BiaffineBackbone=None2021.05 | 94.08 | 95.74 | |
| Dozat and Manning2020.10 | 94 | 95.7 | |
| Zhang192020.05 | 93.96 | — | |
| Division Span HPSGstrategy=Division2019.07 | 93.09 | 94.32 | |
| Ma and Hovy2019.07 | 92.98 | 94.88 | |
| Ma and Hovyyear=20172019.11 | 92.98 | 94.88 | |
| Andor et al.2019.07 | 92.79 | 94.61 | |
| Transformervariant=vanilla sequence-to-sequence2020.10 | 92.6 | 94.4 | |
| Li et al.2019.07 | 92.08 | 94.11 | |
| Li et al.year=20182019.11 | 92.08 | 94.11 | |
| Kuncoro et al.2019.07 | 92.06 | 94.26 | |
| Kuncoro et al.year=20162019.11 | 92.06 | 94.26 | |
| F&K192020.05 | 91.59 | — | |
| Cheng et al.2019.07 | 91.49 | 94.1 | |
| Zhang et al.2019.07 | 91.29 | 93.42 | |
| Chen and Manning2019.07 | 89.6 | 91.8 | |
| Chen and Manning2023.06 | 89.6 | 91.8 |