Syntactic Evaluation on Marvin and Linzen
76.1Syntactic Evaluation ScoreInduced URNNG
Evaluation results
| Method | Links | |
|---|---|---|
| Induced URNNGTraining Supervision=Unsupervised, Base Induction Source=Compound PCFG, Model Objective=URNNG Fine-tuning2019.06 | 76.1 | |
| URNNGTraining Supervision=Supervised, Base Induction Source=Oracle Trees, Model Objective=Fine-tuning2019.06 | 76.1 | |
| RNNGTraining Supervision=Supervised, Base Induction Source=Oracle Trees2019.06 | 70.4 | |
| Induced RNNGTraining Supervision=Unsupervised, Base Induction Source=Compound PCFG2019.06 | 70 | |
| Induced URNNGTraining Supervision=Unsupervised, Base Induction Source=Neural PCFG, Model Objective=URNNG Fine-tuning2019.06 | 69.1 | |
| Induced RNNGTraining Supervision=Unsupervised, Base Induction Source=Neural PCFG2019.06 | 68.1 | |
| PRPNTraining Supervision=Unsupervised2019.06 | 62.2 | |
| Induced URNNGTraining Supervision=Unsupervised, Base Induction Source=ON, Model Objective=URNNG Fine-tuning2019.06 | 61.9 | |
| Induced URNNGTraining Supervision=Unsupervised, Base Induction Source=PRPN, Model Objective=URNNG Fine-tuning2019.06 | 61.8 | |
| Induced RNNGTraining Supervision=Unsupervised, Base Induction Source=ON2019.06 | 61.7 | |
| ONTraining Supervision=Unsupervised2019.06 | 61.6 | |
| LSTM LMTraining Supervision=Unsupervised2019.06 | 60.9 | |
| Induced RNNGTraining Supervision=Unsupervised, Base Induction Source=PRPN2019.06 | 60.1 | |
| Compound PCFGTraining Supervision=Unsupervised2019.06 | 50.7 | |
| Neural PCFGTraining Supervision=Unsupervised2019.06 | 49.2 |