Phrase-structure parsing on PTB (§23)
95.8F1 ScoreWei et al.
Evaluation results
| Method | Links | |
|---|---|---|
| Wei et al.pre-training=true2021.06 | 95.8 | |
| Zhou and Zhaopre-training=true2021.06 | 95.8 | |
| Conditional Splitting Frameworkpre-training=true, backbone=BERT-large-cased, embedding_state=frozen2021.06 | 95.7 | |
| Zhang et al.pre-training=true2021.06 | 95.7 | |
| Kitaev et al.pre-training=true2021.06 | 95.6 | |
| Nguyen et al.pre-training=true2021.06 | 95.5 | |
| RD ∪ RG ∪ LM → RD + RG + LMTraining Data=+S (Silver Data), Model Combination=Reranking + Candidate Union2017.07 | 94.66 | |
| RD ∪ LM → RD + LMTraining Data=+S (Silver Data), Model Combination=Reranking + Candidate Union2017.07 | 94.63 | |
| RD (8) → RD (8) + RG (8) + LMTraining Data=+S (Silver Data), Model Combination=Ensembling + Reranking2017.07 | 94.62 | |
| RD (8) → RD (8) + LMTraining Data=+S (Silver Data), Model Combination=Ensembling + Reranking2017.07 | 94.56 | |
| RD → RD + RG + LMTraining Data=+S (Silver Data), Model Combination=Reranking2017.07 | 94.33 | |
| RD → RD + LMTraining Data=+S (Silver Data), Model Combination=Reranking2017.07 | 94.27 | |
| RD (8) → RD (8) + RG (8) + LMTraining Data=PTB, Model Combination=Ensembling + Reranking2017.07 | 94.25 | |
| RD (8) → RD (8) + RG (8)Training Data=+S (Silver Data), Model Combination=Ensembling + Reranking2017.07 | 94.22 | |
| RD → LMTraining Data=+S (Silver Data), Model Combination=Reranking2017.07 | 94.18 | |
| RD (8) → RD (8) + RG (8)Training Data=PTB, Model Combination=Ensembling + Reranking2017.07 | 94.09 | |
| RD (8) → RD (8) + LMTraining Data=PTB, Model Combination=Ensembling + Reranking2017.07 | 93.97 | |
| RD ∪ RG ∪ LM → RD + RG + LMTraining Data=PTB, Model Combination=Reranking + Candidate Union2017.07 | 93.94 | |
| RD ∪ LM → RD + LMTraining Data=PTB, Model Combination=Reranking + Candidate Union2017.07 | 93.89 | |
| Choe and Charniak (2016)Training Data=+S (Silver Data)2017.07 | 93.8 | |
| RD ∪ RG → RD + RGTraining Data=+S (Silver Data), Model Combination=Reranking + Candidate Union2017.07 | 93.75 | |
| RD → RD + LMTraining Data=PTB, Model Combination=Reranking2017.07 | 93.71 | |
| RD → RD + RGTraining Data=+S (Silver Data), Model Combination=Reranking2017.07 | 93.64 | |
| RD → RD + RG + LMTraining Data=PTB, Model Combination=Reranking2017.07 | 93.63 | |
| RD ∪ RG → RD + RGTraining Data=PTB, Model Combination=Reranking + Candidate Union2017.07 | 93.45 | |
| RD → LMTraining Data=PTB, Model Combination=Reranking2017.07 | 93.31 | |
| RNNG (Generative)implementation=correct, type=generative2016.02 | 93.3 | |
| Generative RNNGSetting=Generative, Model type=Single-model, Additional training data=No2016.11 | 93.3 | |
| Dyer et al. (2016)-generativeTraining Data=PTB2017.07 | 93.3 | |
| RD → RGTraining Data=+S (Silver Data), Model Combination=Reranking2017.07 | 93.29 | |
| RD → RD + RGTraining Data=PTB, Model Combination=Reranking2017.07 | 93.27 | |
| RD → RGTraining Data=PTB, Model Combination=Reranking2017.07 | 92.73 | |
| RD (8) → RD (8)Training Data=PTB, Model Combination=Ensembling (8 copies)2017.07 | 92.72 | |
| Choe and Charniak (2016)Data setting=PTB only, Model type=Single-model, Additional training data=No2016.11 | 92.6 | |
| Choe and Charniak (2016)Training Data=PTB2017.07 | 92.6 | |
| RD (8) → RD (8)Training Data=+S (Silver Data), Model Combination=Ensembling (8 copies)2017.07 | 92.53 | |
| Shindo et al.type=generative, mode=ensemble2016.02 | 92.4 | |
| RNNG (Generative)implementation=buggy, type=generative2016.02 | 92.4 | |
| McClosky et al.type=semisupervised2016.02 | 92.1 | |
| Vinyals et al.type=semisupervised2016.02 | 92.1 | |
| RD → RDTraining Data=+S (Silver Data), Model Combination=Reranking2017.07 | 91.73 | |
| RNNG (Discriminative)implementation=correct, type=discriminative2016.02 | 91.7 | |
| Liu and Zhang (2017)Training Data=PTB2017.07 | 91.7 | |
| Dyer et al. (2016)-discriminativeTraining Data=PTB2017.07 | 91.7 | |
| RD → RDTraining Data=PTB, Model Combination=Reranking2017.07 | 91.51 | |
| Zhu et al.type=semisupervised2016.02 | 91.3 | |
| Discriminative RNNGSetting=Discriminative, Model type=Single-model, Additional training data=No2016.11 | 91.2 | |
| Shindo et al.type=generative, mode=single2016.02 | 91.1 | |
| Bodtype=generative2016.02 | 90.7 | |
| Socher et al.type=discriminative2016.02 | 90.4 | |
| Zhu et al.type=discriminative2016.02 | 90.4 | |
| Petrov and Kleintype=generative2016.02 | 90.1 | |
| RNNG (Discriminative)implementation=buggy, type=discriminative2016.02 | 89.8 | |
| Hendersontype=discriminative2016.02 | 89.4 | |
| Vinyals et al.type=discriminative, trained_on=WSJ only, ensembling=false2016.02 | 88.3 | |
| Vinyals et al. (2015)Data setting=PTB only, Model type=Single-model, Additional training data=No2016.11 | 88.3 |