Grammar Induction on PTB English (test)
84.3F1 ScoreOracle
Evaluation results
| Method | Links | |
|---|---|---|
| Oracle2024.03 | 84.3 | |
| Oracle Binary Trees2019.04 | 82.5 | |
| RNNGtraining=supervised2019.04 | 68.1 | |
| RNNG → URNNGtraining=initialized from supervised RNNG2019.04 | 67.7 | |
| GPST smallcorpus=wiki103, left-to-right=no2024.03 | 57.46 | |
| Fast-R2D2corpus=wiki103, left-to-right=no2024.03 | 57.2 | |
| GPST mediumcorpus=opw, left-to-right=no2024.03 | 56.27 | |
| DIORAcorpus=WSJ, left-to-right=no2024.03 | 55.7 | |
| GPST smallcorpus=wiki103, left-to-right=yes2024.03 | 55.25 | |
| C-PCFGcorpus=WSJ, left-to-right=no2024.03 | 55.2 | |
| GPST mediumcorpus=opw, left-to-right=yes2024.03 | 54.71 | |
| GPST smallcorpus=opw, left-to-right=no2024.03 | 53.95 | |
| GPST smallcorpus=opw, left-to-right=yes2024.03 | 51.4 | |
| GPST small w/o surrogatecorpus=wiki103, left-to-right=no2024.03 | 50.27 | |
| ON-LSTMcorpus=WSJ, left-to-right=no2024.03 | 47.4 | |
| URNNGcorpus=WSJ, left-to-right=no2024.03 | 45.4 | |
| GPST small w/o synccorpus=wiki103, left-to-right=yes2024.03 | 43.64 | |
| GPST medium w/o synccorpus=opw, left-to-right=yes2024.03 | 43.37 | |
| GPST small w/o synccorpus=opw, left-to-right=yes2024.03 | 43.09 | |
| GPST small w/o grad.stopcorpus=wiki103, left-to-right=no2024.03 | 42.46 | |
| NV(+linguistic rules)corpus=WSJ, left-to-right=yes2024.03 | 42 | |
| PRPNHyperparameters=tuned2019.04 | 41.2 | |
| URNNGtraining=unsupervised2019.04 | 40.7 | |
| PRPNcorpus=WSJ, left-to-right=yes2024.03 | 37.4 | |
| Right Branching Trees2019.04 | 34.8 | |
| PRPNHyperparameters=default2019.04 | 32.9 | |
| NV(unsupervised)corpus=WSJ, left-to-right=yes2024.03 | 29 | |
| Random Trees2019.04 | 15 | |
| Left Branching Trees2019.04 | 10.3 |