Word Sense Disambiguation on SensEval-3 (test)
80.12F1 ScoreBERT kNN
Evaluation Results
| Method | Links | |
|---|---|---|
| BERT kNNk=102019.09 | 80.12 | |
| BERT kNNk=72019.09 | 80.02 | |
| BERT kNNk=92019.09 | 79.97 | |
| BERT kNNk=82019.09 | 79.86 | |
| BERT kNNk=62019.09 | 79.81 | |
| BERT kNNk=52019.09 | 79.79 | |
| BERT kNNk=32019.09 | 79.66 | |
| BERT kNNk=502019.09 | 79.66 | |
| BERT kNNk=1002019.09 | 79.63 | |
| BERT kNNk=5002019.09 | 79.63 | |
| BERT kNNk=10002019.09 | 79.63 | |
| SemEq-Large-ExpertTS=true, IK=M, MS=Large, Strategy=Transfer Learning2021.10 | 79.6 | |
| BERT kNNk=42019.09 | 79.55 | |
| EWISERTS=true, IK=S, GS=true, MS=Large2021.10 | 79 | |
| BERT kNNk=12019.09 | 78.62 | |
| BERT kNNk=22019.09 | 78.62 | |
| SemEq-Base-ExpertTS=true, IK=M, MS=Base, Strategy=Transfer Learning2021.10 | 78.5 | |
| AdaptBERT_LargeTS=true, IK=S, MS=Large2021.10 | 77.8 | |
| SemEq-BaseTS=true, IK=M, MS=Base, Strategy=Data Augmentation2021.10 | 77.7 | |
| BEMTS=true, MS=Base2021.10 | 77.4 | |
| SemEq-BaseTS=true, MS=Base2021.10 | 77.2 | |
| LMMS_BERTTS=true, MS=Large2021.10 | 75.6 | |
| GlossBERTTS=true, MS=Base2021.10 | 75.2 | |
| SemEq-Large-GeneralIK=M, MS=Large, Strategy=Transfer Learning2021.10 | 74.3 | |
| BERT Layer Weighting (LW)Context Window=1 sentence + 1 surrounding2019.10 | 74 | |
| BERT Gated Linear Unit (GLU)Context Window=1 sentence + 1 surrounding2019.10 | 73.6 | |
| Kågebäck2019.09 | 73.4 | |
| BERT Simple Linear ProjectionContext Window=1 sentence + 1 surrounding2019.10 | 73.4 | |
| BERT GLU+LWContext Window=1 sentence + 1 surrounding2019.10 | 73.4 | |
| BERT 1nnContext Window=1 sentence + 1 surrounding2019.10 | 71.6 | |
| BERT Simple Linear ProjectionContext Window=1 sentence2019.10 | 71.6 | |
| BERT Layer Weighting (LW)Context Window=1 sentence2019.10 | 71.6 | |
| BERT Gated Linear Unit (GLU)Context Window=1 sentence2019.10 | 71.6 | |
| EWISETS=true, GS=true2021.10 | 71.1 | |
| BERT GLU+LWContext Window=1 sentence2019.10 | 70.9 | |
| SemEq-Base-GeneralIK=M, MS=Base, Strategy=Transfer Learning2021.10 | 70.9 | |
| SupWSD+embembeddings=word2vec2019.10 | 70.6 | |
| GASext Concat2019.10 | 70.5 | |
| HCANTS=true2021.10 | 70.3 | |
| BERT 1nnContext Window=1 sentence2019.10 | 69.7 | |
| ELMO2019.10 | 69.6 | |
| BiLSTMatt+LEX2019.10 | 69.4 | |
| IMSembeddings=none2019.10 | 69.3 | |
| IMS+embembeddings=word2vec2019.10 | 69.3 | |
| context2vec2019.10 | 69.1 | |
| SupWSDembeddings=none2019.10 | 68.8 | |
| BiLSTMTS=true2021.10 | 68.4 | |
| MFS baseline2019.10 | 66 | |
| Most Frequent SenseTS=true2021.10 | 66 | |
| Lesk_embTS=true, GS=true2021.10 | 63.7 | |
| MFS2019.09 | 58.95 |