Binary Semantic Change Detection on SemEval Subtask 1 2020 (Multi-lingual)
68.7Average AccuracyBest shared task system
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Best shared task system2026.01 | 68.7 | 62.2 | 75 | 70 | 67.7 | |
| Count baseline2026.01 | 61.3 | 59.5 | 68.8 | 52.5 | 64.5 | |
| SE 2 No POSSystem=SemEval, Frequency Filtering=true, POS Removal=true2026.01 | 60.6 | 64.9 | 60.4 | 52.5 | 64.5 | |
| SE 2System=SemEval, Frequency Filtering=true2026.01 | 59.3 | 64.9 | 60.4 | 47.5 | 64.5 | |
| SE No POSSystem=SemEval, POS Removal=true2026.01 | 59 | 59.5 | 64.6 | 47.5 | 64.5 | |
| SE 2 No POS DPSystem=SemEval, Frequency Filtering=true, POS Removal=true, Dependency Parsing=true2026.01 | 58.5 | 62.1 | 60.4 | 50 | 61.3 | |
| SZSystem=Stanza, Procedure=Basic2026.01 | 58.3 | 54.1 | 60.4 | 47.5 | 71 | |
| SZ No POSSystem=Stanza, POS Removal=true2026.01 | 58.3 | 54.1 | 60.4 | 47.5 | 71 | |
| SESystem=SemEval, Procedure=Basic2026.01 | 58 | 59.5 | 60.4 | 47.5 | 64.5 | |
| SZ 2System=Stanza, Frequency Filtering=true2026.01 | 56.9 | 48.6 | 60.4 | 47.5 | 71 | |
| SZ 2 No POSSystem=Stanza, Frequency Filtering=true, POS Removal=true2026.01 | 56.5 | 48.6 | 60.4 | 52.5 | 64.5 |