Graded Semantic Change Detection on SemEval Subtask 2 2020
0.583Average ScoreBest shared task system
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Best shared task system2026.01 | 0.583 | 0.757 | 0.877 | -0.056 | 0.754 | |
| SE 2 No POSTokenizer=SemEval, Frequency Filtering=True, POS Removal=True2026.01 | 0.239 | 0.277 | 0.258 | 0.258 | 0.162 | |
| SE 2Tokenizer=SemEval, Frequency Filtering=True2026.01 | 0.229 | 0.266 | 0.253 | 0.215 | 0.181 | |
| Count baseline2026.01 | 0.144 | 0.022 | 0.216 | 0.359 | -0.022 | |
| SZ 2 No POSTokenizer=Stanza, Frequency Filtering=True, POS Removal=True2026.01 | 0.139 | -0.008 | 0.193 | 0.197 | 0.173 | |
| SZ 2Tokenizer=Stanza, Frequency Filtering=True2026.01 | 0.129 | -0.01 | 0.191 | 0.142 | 0.192 | |
| SE No POSTokenizer=SemEval, POS Removal=True2026.01 | 0.117 | 0.115 | 0.175 | 0.038 | 0.141 | |
| SZ No POSTokenizer=Stanza, POS Removal=True2026.01 | 0.113 | 0.139 | 0.145 | 0.001 | 0.166 | |
| SZTokenizer=Stanza, Procedure=Basic2026.01 | 0.108 | 0.139 | 0.12 | 0.017 | 0.155 | |
| SETokenizer=SemEval, Procedure=Basic2026.01 | 0.096 | 0.108 | 0.135 | 0.026 | 0.115 |