Word-in-Context (WiC) on XL-WiC IV
85.1Accuracy (De)SDML
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SDML2024.03 | 85.1 | 78.5 | 77.8 | |
| Lang. BERTType=Language-specific BERT models2024.03 | 83.2 | 77.6 | 73.9 | |
| XLM-RoBERTalargeBackbone=XLM-RoBERTa-large2024.03 | 82.2 | 75.6 | 75.1 | |
| mBERTbaseBackbone=mBERT-base2024.03 | 81.9 | 72.9 | 73.2 | |
| XLM-RoBERTabaseBackbone=XLM-RoBERTa-base2024.03 | 81.2 | 71.9 | 70.7 | |
| XL-LEXEMEType=Sense-aware encoder2024.03 | 78.4 | 73.6 | 71.2 |