Word-in-Context binary classification on AM2iCo (test)
85Accuracy (De)SDML
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| SDMLCategory=Sense-Aware Method, Full Name=Semantic Distance Metric Learning2024.03 | 85 | 87.6 | 82.9 | 81.7 | 81.8 | 82.9 | 87.7 | 84.4 | 83.6 | 80.8 | |
| mBERT_baseCategory=MLM Baseline, Classifier=Binary logistic regression, MLM Parameters Updated=false2024.03 | 80.4 | 82.1 | 78.2 | 75.2 | 73.3 | 75.8 | 81.2 | 80.6 | 78.4 | 75.9 | |
| XLM-RoBERTa_baseCategory=MLM Baseline, Classifier=Binary logistic regression, MLM Parameters Updated=false2024.03 | 79.4 | 80.9 | 79.4 | 76.1 | 73.6 | 76 | 81.2 | 80.5 | 77.9 | 74.2 | |
| XL-LEXEMECategory=Sense-Aware Method, Fine-tuned=true2024.03 | 78.1 | 78.2 | 77.1 | 75.2 | 75.4 | 75.5 | 78 | 78.7 | 75.5 | 72.7 |