Semantic Parsing on UCCA 20K Leagues set out-of-domain (test)
68.7Primary Labeled PrecisionTUPABiLSTM
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| TUPABiLSTMDecoding Strategy=Greedy, Feature Type=Neural (BiLSTM)2017.04 | 68.7 | 68.5 | 68.6 | 38.6 | 18.8 | 25.3 | |
| LSTM ParserApproximation Method=Bilexical Tree Approximation (Dependency Tree Parsers), Decoding Strategy=Greedy2017.04 | 66.1 | 61.1 | 63.5 | — | — | — | |
| TUPAMLPDecoding Strategy=Greedy, Feature Type=Neural (MLP)2017.04 | 62.3 | 62.6 | 62.5 | 20.9 | 6.3 | 9.7 | |
| TUPAsparseDecoding Strategy=Greedy, Feature Type=Sparse2017.04 | 59.6 | 59.9 | 59.8 | 22.2 | 7.7 | 11.5 | |
| MaltParserApproximation Method=Bilexical Tree Approximation (Dependency Tree Parsers), Decoding Strategy=Greedy2017.04 | 57.8 | 53 | 55.3 | — | — | — | |
| DAGParserApproximation Method=Bilexical Approximation (Dependency DAG Parsers), Decoding Strategy=Beam Search (size 5)2017.04 | 56.4 | 50.6 | 53.4 | 0 | 0 | 0 | |
| UPARSEApproximation Method=Tree Approximation (Constituency Tree Parser), Decoding Strategy=Beam Search (size 4)2017.04 | 52.7 | 52.8 | 52.8 | — | — | — | |
| TurboParserApproximation Method=Bilexical Approximation (Dependency DAG Parsers), Decoding Strategy=Greedy2017.04 | 50.3 | 37.7 | 43.1 | 100 | 0.4 | 0.8 |