Unsupervised Constituency Parsing on WSJ (test)
84.3Max F1Oracle Trees
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Oracle Trees2021.04 | 84.3 | — | |
| Inside-Outside Co-training Parsertrained_on_additional_data=true2021.10 | 66.8 | 63.1 | |
| CTpretrained_word_embeddings=true2021.04 | 65.9 | 62.8 | |
| Constituency Testtrained_on_additional_data=true2021.10 | 65.9 | 62.8 | |
| Inside Model with self-training (Ours)trained_on_additional_data=true2021.10 | 64.2 | 61.4 | |
| S-DIORApretrained_word_embeddings=true2021.04 | 64 | 57.6 | |
| S-DIORAtrained_on_additional_data=true2021.10 | 64 | 57.6 | |
| TN-PCFGpretrained_word_embeddings=false, p=5002021.04 | 61.4 | 57.7 | |
| C-PCFGpretrained_word_embeddings=false2021.04 | 60.1 | 55.2 | |
| Compound PCFG2021.10 | 60.1 | 55.2 | |
| C-PCFG* w/ MBRpretrained_word_embeddings=false, implementation=reimplemented, decoding=MBR2021.04 | 60 | 56.3 | |
| C-PCFG*pretrained_word_embeddings=false, implementation=reimplemented2021.04 | 59 | 55.4 | |
| DIORAtrained_without_punctuation=true2021.10 | 58.9 | — | |
| Inside Model (Ours)trained_on_additional_data=true2021.10 | 57.2 | 55.9 | |
| DIORApretrained_word_embeddings=true2021.04 | 56.8 | — | |
| N-PCFG* w/ MBRpretrained_word_embeddings=false, implementation=reimplemented, decoding=MBR2021.04 | 55.8 | 52.3 | |
| TN-PCFGpretrained_word_embeddings=false, p=602021.04 | 55.6 | 51.4 | |
| NL-PCFGpretrained_word_embeddings=false2021.04 | 55.3 | — | |
| N-PCFG*pretrained_word_embeddings=false, implementation=reimplemented2021.04 | 54.6 | 50.9 | |
| N-PCFGpretrained_word_embeddings=false2021.04 | 52.6 | 50.8 | |
| Neural PCFG2021.10 | 52.6 | 50.8 | |
| Tree Transformertrained_on_additional_data=true2021.10 | 52 | 50.5 | |
| ONpretrained_word_embeddings=false2021.04 | 50 | 48.1 | |
| ON2021.10 | 49.4 | 47.7 | |
| PRPNpretrained_word_embeddings=false2021.04 | 47.9 | 47.3 | |
| Right Branchingtype=Rule-based baseline2021.04 | 39.5 | — | |
| PRPN2021.10 | 38.1 | 37.4 | |
| Random Treestype=Baseline2021.04 | 18.2 | 18.1 | |
| Left Branchingtype=Rule-based baseline2021.04 | 8.7 | — | |
| Balanced2021.10 | — | 18.5 | |
| Left Branching (LB)2021.10 | — | 8.7 | |
| Oracle Binary Trees2021.10 | — | 84.3 | |
| Right Branching (RB)2021.10 | — | 39.5 | |
| URNNGtrained_without_punctuation=true2021.10 | — | 45.4 |