Word Sense Disambiguation on WiC v1.0 (test)
72.1AccuracySenseBERT
Evaluation Results
| Method | Links | |
|---|---|---|
| SenseBERT2019.08 | 72.1 | |
| SenseBERT_LARGE2019.08 | 72.1 | |
| KnowBert-W+Wmodel=KnowBert with WordNet and Wikipedia2019.09 | 70.9 | |
| KnowBert-W+Wknowledge_source=WordNet + Wikipedia2019.09 | 70.9 | |
| KnowBERT-W+W2019.08 | 70.9 | |
| SenseBERT_BASE2019.08 | 70.3 | |
| RoBERTa2019.08 | 69.9 | |
| BERT LARGE2019.08 | 69.6 | |
| BERT_LARGE2019.08 | 69.6 | |
| BERT_LARGEsource=Wang et al. (2019a)2019.09 | 69.5 | |
| BERT_LARGEsource=Wang et al. (2019a)2019.09 | 69.5 | |
| BERT sense embeddings2019.08 | 67.7 | |
| BERT_LARGEsource=Pilehvar and Camacho-Collados (2019)2019.09 | 65.5 | |
| BERT_LARGEsource=Pilehvar and Camacho-Collados (2019)2019.09 | 65.5 | |
| BERT_BASEsource=Pilehvar and Camacho-Collados (2019)2019.09 | 65.4 | |
| BERT_BASEsource=Pilehvar and Camacho-Collados (2019)2019.09 | 65.4 | |
| ELMosource=Pilehvar and Camacho-Collados (2019)2019.09 | 57.7 | |
| ELMosource=Pilehvar and Camacho-Collados (2019)2019.09 | 57.7 | |
| ELMo2019.08 | 57.7 |