Word Similarity on WS-353 (test)
0.8231Spearman CorrelationGloVe + Whitening
Evaluation results
| Method | Links | |
|---|---|---|
| GloVe + WhiteningPrior=Uniform2024.11 | 0.8231 | |
| GloVe + WhiteningPrior=Zipfian2024.11 | 0.809 | |
| GloVe + CenteringPrior=Zipfian2024.11 | 0.7966 | |
| GloVeProcessing=None2024.11 | 0.787 | |
| ROBERTA2STATIC_paraParent Model=ROBERTA-12, Dim.=7682021.06 | 0.7638 | |
| BERT2STATIC_paraParent Model=BERT-12, Dim.=7682021.06 | 0.7598 | |
| GloVe + CenteringPrior=Uniform2024.11 | 0.7539 | |
| ROBERTA2STATIC_sentParent Model=ROBERTA-12, Dim.=7682021.06 | 0.7452 | |
| SENT2VECDim.=7682021.06 | 0.7407 | |
| BERT2STATIC_sentParent Model=BERT-12, Dim.=7682021.06 | 0.7297 | |
| GPT2STATIC_paraParent Model=GPT2-12, Dim.=7682021.06 | 0.7267 | |
| GPT2STATIC_sentParent Model=GPT2-12, Dim.=7682021.06 | 0.7151 | |
| SKIPGRAMDim.=7682021.06 | 0.7141 | |
| ASE - best layer per taskParent Model=BERT-12, Dim.=768, Layer=12021.06 | 0.7012 | |
| ASE - best overall layerParent Model=BERT-12, Dim.=768, Layer=32021.06 | 0.6768 | |
| FASTTEXTDim.=3002021.06 | 0.596 | |
| GLOVEDim.=3002021.06 | 0.5791 | |
| CBOWDim.=7682021.06 | 0.4999 |