Lexical Semantic Recognition on STREUSLE 4.3 (test)
82.5Accuracy (Tags, Full)neural CRF tagger
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| neural CRF taggerEmbeddings=BERT + GloVe, POS/lemma constraints=Gold2020.04 | 82.5 | 79.3 | 82.7 | 89.9 | 69 | 66.1 | 77.1 | 72.1 | 80 | 64.9 | 71.6 | 59.5 | |
| neural CRF taggerEmbeddings=BERT + GloVe, POS/lemma constraints=None (MWE only)2020.04 | 82 | 77.1 | 82.7 | 89.1 | 69.6 | 64.9 | 76.8 | 70.3 | 82 | 64.3 | 72 | 60.3 | |
| neural CRF taggerEmbeddings=BERT + GloVe, POS/lemma constraints=Predicted2020.04 | 81 | 77.5 | 81.7 | 87.9 | 68 | 65.7 | 75.1 | 70 | 77.6 | 63.1 | 69.5 | 60.3 |