Word Sense Disambiguation on SemEval-2007 Task 17 (test)
71.4F1 ScoreVial et al.
Evaluation results
| Method | Links | |
|---|---|---|
| Vial et al.year=20192019.09 | 71.4 | |
| BERT Simple Linear ProjectionContext Window=1 sentence + 1 surrounding2019.10 | 69.3 | |
| BERT Layer Weighting (LW)Context Window=1 sentence + 1 surrounding2019.10 | 69 | |
| BERT GLU+LWContext Window=1 sentence + 1 surrounding2019.10 | 68.5 | |
| BERT Gated Linear Unit (GLU)Context Window=1 sentence + 1 surrounding2019.10 | 68.1 | |
| BERT Simple Linear ProjectionContext Window=1 sentence2019.10 | 67 | |
| Vial et al.year=20182019.09 | 66.81 | |
| BERT Layer Weighting (LW)Context Window=1 sentence2019.10 | 66.7 | |
| BERT GLU+LWContext Window=1 sentence2019.10 | 65.7 | |
| BERT Gated Linear Unit (GLU)Context Window=1 sentence2019.10 | 64.9 | |
| BERT 1nnContext Window=1 sentence2019.10 | 64 | |
| Yuan et al.2019.09 | 63.7 | |
| BiLSTMatt+LEX2019.10 | 63.7 | |
| BERT 1nnContext Window=1 sentence + 1 surrounding2019.10 | 63.3 | |
| SupWSD+embembeddings=word2vec2019.10 | 63.1 | |
| ELMO2019.10 | 62.2 | |
| IMSembeddings=none2019.10 | 61.3 | |
| context2vec2019.10 | 61.3 | |
| BERT kNNk=502019.09 | 60.94 | |
| IMS+embembeddings=word2vec2019.10 | 60.9 | |
| BERT kNNk=1002019.09 | 60.71 | |
| BERT kNNk=5002019.09 | 60.71 | |
| BERT kNNk=10002019.09 | 60.71 | |
| BERT kNNk=72019.09 | 60.49 | |
| BERT kNNk=82019.09 | 60.49 | |
| BERT kNNk=92019.09 | 60.49 | |
| BERT kNNk=102019.09 | 60.49 | |
| BERT kNNk=52019.09 | 60.27 | |
| BERT kNNk=62019.09 | 60.27 | |
| SupWSDembeddings=none2019.10 | 60.2 | |
| BERT kNNk=12019.09 | 59.82 | |
| BERT kNNk=22019.09 | 59.82 | |
| BERT kNNk=42019.09 | 59.82 | |
| BERT kNNk=32019.09 | 59.38 | |
| MFS baseline2019.10 | 54.5 | |
| MFS2019.09 | 48.44 |