Lexical Semantic Change Detection on SemEval Task 1 Subtask 2 English 2020
0.774Spearman CorrelationSDML
Evaluation Results
| Method | Links | |
|---|---|---|
| SDMLEK (External Knowledge)=true2026.02 | 0.774 | |
| XL-LEXEME2024.04 | 0.757 | |
| XL-LEXEMEEK (External Knowledge)=true2026.02 | 0.757 | |
| XL-LexemeSystem type=token2026.02 | 0.757 | |
| Replacement SchemaReplacement Strategy=Synonym, Aggregation Statistic=Max. Corr.2024.04 | 0.741 | |
| Replacement SchemaReplacement Strategy=Synonym, Aggregation Statistic=Avg. Corr.2024.04 | 0.674 | |
| LT-1960-2010EK (External Knowledge)=false2026.02 | 0.667 | |
| Definition embeddingsInterpretability=Non-interpretable2024.06 | 0.637 | |
| Rosin and Radinsky2024.04 | 0.629 | |
| Replacement SchemaReplacement Strategy=Random, Aggregation Statistic=Max. Corr.2024.04 | 0.622 | |
| Kutuzov and Giulianelli2024.04 | 0.605 | |
| Replacement SchemaReplacement Strategy=Synonym, Aggregation Statistic=Min. Corr.2024.04 | 0.6 | |
| LMMS sense embeddingsInterpretability=Interpretable2024.06 | 0.589 | |
| SSCSEK (External Knowledge)=true2026.02 | 0.589 | |
| LeskInterpretability=Interpretable, Part-of-Speech=with PoS2024.06 | 0.587 | |
| Laicher et al.2024.04 | 0.571 | |
| APDEK (External Knowledge)=false2026.02 | 0.571 | |
| Definitions as sensesInterpretability=Interpretable2024.06 | 0.565 | |
| ScaledJSDEK (External Knowledge)=false2026.02 | 0.547 | |
| Replacement SchemaReplacement Strategy=Random, Aggregation Statistic=Avg. Corr.2024.04 | 0.542 | |
| ARES sense embeddingsInterpretability=Interpretable2024.06 | 0.529 | |
| XLM-R token embeddingsInterpretability=Non-interpretable2024.06 | 0.514 | |
| Periti et al.2024.04 | 0.512 | |
| Replacement SchemaReplacement Strategy=Random, Aggregation Statistic=Min. Corr.2024.04 | 0.495 | |
| NLPCREK (External Knowledge)=false2026.02 | 0.436 | |
| NLPCRSystem type=token2026.02 | 0.436 | |
| LeskInterpretability=Interpretable, Part-of-Speech=without PoS2024.06 | 0.423 | |
| UG_Student_InternSystem type=type2026.02 | 0.422 | |
| SSCDEK (External Knowledge)=false2026.02 | 0.383 | |
| cs2020System type=type2026.02 | 0.375 | |
| UWBSystem type=type2026.02 | 0.367 | |
| Discovery_TeamSystem type=ens.2026.02 | 0.361 | |
| Jiaxin & JinanSystem type=type2026.02 | 0.325 | |
| UCDSystem type=graph2026.02 | 0.307 | |
| FrameNet-FTFEDescription=Frame-Trigger-Frame-Element2026.02 | 0.306 | |
| IMSSystem type=type2026.02 | 0.301 | |
| Life-LanguageSystem type=type2026.02 | 0.299 | |
| Syntactic Dependency2026.02 | 0.277 | |
| EntitySystem type=type2026.02 | 0.25 | |
| FrameNet-FEDescription=Frame Element2026.02 | 0.249 | |
| RPI-TrustSystem type=type2026.02 | 0.228 | |
| Grammatical Profiling2026.02 | 0.218 | |
| RandomSystem type=type2026.02 | 0.211 | |
| SkurtSystem type=token2026.02 | 0.209 | |
| RIJPSystem type=type2026.02 | 0.157 | |
| UiO-UvASystem type=token2026.02 | 0.136 | |
| UoBSystem type=topic2026.02 | 0.105 | |
| cbkSystem type=token2026.02 | 0.059 | |
| NLP@IDSIASystem type=token2026.02 | 0.028 | |
| Count Bas.2026.02 | 0.022 | |
| JCTSystem type=type2026.02 | 0.014 | |
| TUESystem type=token2026.02 | -0.155 | |
| DCCSystem type=type2026.02 | -0.217 | |
| Freq. Bas.2026.02 | -0.217 |