List your company
ResearchFormerly WizWand

Word Similarity on SimVerb-3500 (test)

0.764Spearman CorrelationPOST-DFFN
0.167040.322020.4770.63198Sep 11, 2018Oct 16, 2019Nov 19, 2020Dec 24, 2021Jan 28, 2023Mar 3, 2024Apr 8, 2025
Updated 8mo ago

Evaluation results

MethodLinks
POST-DFFNVector space=GLOVE-CC2018.090.764
AUXGANVector space=GLOVE-CC2018.090.764
POST-DFFNVector space=SGNS-W22018.090.763
AUXGANVector space=SGNS-W22018.090.762
ATTRACT-REPELVector space=GLOVE-CC2018.090.761
ATTRACT-REPELVector space=SGNS-W22018.090.761
POST-DFFNVector space=FASTTEXT2018.090.745
ATTRACT-REPELVector space=FASTTEXT2018.090.744
AUXGANVector space=FASTTEXT2018.090.741
SOTA (Multi)Type=Special-purpose SOTA model (Multi vector)2023.050.528
Sim14Sense Selection=Sense 14 (Verb objects, nmod nouns)2023.050.502
SOTA (Single)Type=Special-purpose SOTA model (Single vector)2023.050.473
Sim12Sense Selection=Sense 12 (relatedness)2023.050.471
SimminSense Selection=Minimum Sense Cosine2023.050.471
Flan-T5-SDBackbone=Flan-T5-xxl, Clusters (k)=52025.040.439
DRG2VecType=Discrete embeddings2025.040.425
BERT-SDBackbone=BERT, Clusters (k)=52025.040.425
GPT2-1.5BCategory=Large existing models2023.050.418
Dict2VecType=Discrete embeddings2025.040.379
GPT-J-6BCategory=Large existing models2023.050.374
word2vecEmbedding Type=Classic Non-Contextual2023.050.367
Trnsf 124MType=Baseline Transformer2023.050.363
Distributional (X)Vector space=GLOVE-CC2018.090.28
Distributional (X)Vector space=SGNS-W22018.090.272
Distributional (X)Vector space=FASTTEXT2018.090.247
GloVeEmbedding Type=Classic Non-Contextual2023.050.227
Word2VecType=Discrete embeddings2025.040.19