List your company
ResearchFormerly WizWand

Word Similarity on WS-353 SIM (test)

0.807Spearman CorrelationSOTA (Multi)
0.5990.6530.7070.761May 26, 2023Sep 16, 2023Jan 8, 2024May 1, 2024Aug 23, 2024Dec 15, 2024Apr 8, 2025
Updated 8mo ago

Evaluation results

MethodLinks
SOTA (Multi)Type=Special-purpose SOTA model (Multi vector)2023.050.807
Flan-T5-SDBackbone=Flan-T5-xxl, Clusters (k)=52025.040.799
BERT-SDBackbone=BERT, Clusters (k)=52025.040.794
SOTA (Single)Type=Special-purpose SOTA model (Single vector)2023.050.764
Sim12Sense Selection=Sense 12 (relatedness)2023.050.749
DRG2VecType=Discrete embeddings2025.040.728
GPT2-1.5BCategory=Large existing models2023.050.706
Dict2VecType=Discrete embeddings2025.040.696
word2vecEmbedding Type=Classic Non-Contextual2023.050.684
Trnsf 124MType=Baseline Transformer2023.050.681
Word2VecType=Discrete embeddings2025.040.679
GPT-J-6BCategory=Large existing models2023.050.673
Sim14Sense Selection=Sense 14 (Verb objects, nmod nouns)2023.050.655
GloVeEmbedding Type=Classic Non-Contextual2023.050.607
SimminSense Selection=Minimum Sense Cosine2023.050.607