Penn Treebank
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Penn Treebank WSJ section 22 (dev)
93.5F1 Score
9
Penn Treebank (PTB) zero-shot transfer (test)
72.21Perplexity (zero-shot)
8
Penn Treebank v1 (test)
72.81-shot Accuracy (random)
8
Penn Treebank medium (test)
78.3Perplexity
7
Penn Treebank (PTB)
97.97Accuracy
6
Penn Treebank medium (val)
81.9Perplexity
6
Penn Treebank (test)
84.46Inner F1 (All)
5
Penn Treebank (train)
31.92Perplexity
4
Penn Treebank (PTB) CoreNLP 3.3.0 converted (test)
0.97UAS
3
Penn Treebank (dev)
95.5F1 Score
3
Penn Treebank Char-level
1.22BPC
2
Penn Treebank Word-level
47.7Perplexity
2
Penn Treebank (PTB) Characters (test)
89.4FPR90
2
WSJ (Penn Treebank) (test)
0.96AUROC
2