Word Sense Disambiguation on FEWS (test)
90.7F1 ScoreGlossGPT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| GlossGPTEvaluation Protocol=Fewshot2026.03 | 90.7 | — | — | — | |
| ESRLEvaluation Protocol=Fewshot2026.03 | 83.4 | — | — | — | |
| SemEqLEvaluation Protocol=Fewshot2026.03 | 82.3 | — | — | — | |
| SemEqbEvaluation Protocol=Fewshot2026.03 | 80.1 | — | — | — | |
| GlossGPTEvaluation Protocol=Zeroshot2026.03 | 79.5 | — | — | — | |
| RTWELEvaluation Protocol=Fewshot2026.03 | 78.4 | — | — | — | |
| ESRbEvaluation Protocol=Fewshot2026.03 | 77.8 | — | — | — | |
| QwenEvaluation Protocol=Fewshot, Number of parameters=4B2026.03 | 76.52 | — | — | — | |
| ESRLEvaluation Protocol=Zeroshot2026.03 | 75.8 | — | — | — | |
| GemmaEvaluation Protocol=Fewshot, Number of parameters=4B2026.03 | 75.68 | — | — | — | |
| QwenEvaluation Protocol=Zeroshot, Number of parameters=4B2026.03 | 72.66 | — | — | — | |
| SemEqLEvaluation Protocol=Zeroshot2026.03 | 72.2 | — | — | — | |
| GemmaEvaluation Protocol=Zeroshot, Number of parameters=4B2026.03 | 71.86 | — | — | — | |
| ESRbEvaluation Protocol=Zeroshot2026.03 | 71.6 | — | — | — | |
| SemEqbEvaluation Protocol=Zeroshot2026.03 | 70.2 | — | — | — | |
| RTWELEvaluation Protocol=Zeroshot2026.03 | 69.9 | — | — | — | |
| MFSEvaluation Protocol=Fewshot2026.03 | 51.5 | — | — | — | |
| LeskEvaluation Protocol=Fewshot2026.03 | 40.9 | — | — | — | |
| LeskEvaluation Protocol=Zeroshot2026.03 | 39 | — | — | — | |
| BEMTraining Set of FEWS=true2021.10 | — | 72.8 | 79.1 | 66.5 | |
| BEM_SemCorTraining Set of FEWS=true2021.10 | — | 73 | 78.9 | 67.1 | |
| Lesk_embTraining Set of FEWS=false2021.10 | — | 41.5 | 44.1 | 39 | |
| Most Frequent SenseTraining Set of FEWS=true2021.10 | — | 25.7 | 51.5 | 0 | |
| SemEq-BaseTraining Set of FEWS=true2021.10 | — | 72.4 | 78.5 | 66.3 | |
| SemEq-Base (+ WSI)Training Set of FEWS=true2021.10 | — | 73.7 | 78.6 | 68.7 | |
| SemEq-Base-ExpertTraining Set of FEWS=true2021.10 | — | 75.2 | 80.1 | 70.2 | |
| SemEq-Base-GeneralTraining Set of FEWS=false2021.10 | — | 67 | 67.7 | 66.3 | |
| SemEq-Large-ExpertTraining Set of FEWS=true2021.10 | — | 77.3 | 82.3 | 72.2 | |
| SemEq-Large-GeneralTraining Set of FEWS=false2021.10 | — | 69.8 | 71.2 | 68.4 |