Word Similarity on WS-353
0.789Spearman Correlation (WS-353)Ours (+post-process)
Evaluation Results
| Method | Links | |
|---|---|---|
| Ours (+post-process)Type=Context-to-Vec, Post-processing=With post-processing2022.10 | 0.789 | |
| Ours (+post-process)Type=Context-to-Vec, Post-processing=With post-processing2022.10 | 0.77 | |
| Ours (preliminary)Type=Context-to-Vec, Post-processing=None2022.10 | 0.769 | |
| Ours (preliminary)Type=Context-to-Vec, Post-processing=None2022.10 | 0.767 | |
| ROBERTA2STATICparaParent Model=ROBERTA-122021.06 | 0.7638 | |
| BERT+Skip-gramType=Context-to-Vec2022.10 | 0.753 | |
| FASTTEXTType=Static2022.10 | 0.746 | |
| XLNetType=Contextualized, Representation level=token2022.10 | 0.744 | |
| SENT2VECDim.=7682021.06 | 0.7407 | |
| RPAMModel=GPT-2, Template=TP22026.07 | 0.74 | |
| SynGCNType=Context-to-Vec2022.10 | 0.732 | |
| DepsType=Static2022.10 | 0.731 | |
| BERT2STATICsentParent Model=BERT-122021.06 | 0.7297 | |
| BERT+Skip-gramType=Context-to-Vec2022.10 | 0.728 | |
| XLNetType=Contextualized, Representation level=avg2022.10 | 0.723 | |
| GPT2Type=Contextualized, Representation level=avg2022.10 | 0.721 | |
| GPT2Type=Contextualized, Representation level=token2022.10 | 0.715 | |
| SKIPGRAMDim.=7682021.06 | 0.7141 | |
| ELMoType=Contextualized, Representation level=avg2022.10 | 0.713 | |
| CBOWType=Static2022.10 | 0.707 | |
| ASE - best layer per taskParent Model=BERT-12, Dim.=768, Layer=12021.06 | 0.7012 | |
| XLNetType=Contextualized, Representation level=word2022.10 | 0.698 | |
| ELMoType=Contextualized, Representation level=token2022.10 | 0.691 | |
| Skip-gramType=Static2022.10 | 0.689 | |
| FASTTEXTType=Static2022.10 | 0.683 | |
| BERTType=Contextualized, Representation level=token2022.10 | 0.673 | |
| BERTType=Contextualized, Representation level=avg2022.10 | 0.67 | |
| ContextLSTMType=Context-to-Vec2022.10 | 0.666 | |
| PriorModel=GPT-22026.07 | 0.66 | |
| GPT2Type=Contextualized, Representation level=token2022.10 | 0.655 | |
| XLNetType=Contextualized, Representation level=avg2022.10 | 0.649 | |
| GPT2Type=Contextualized, Representation level=avg2022.10 | 0.645 | |
| GloVeType=Static2022.10 | 0.643 | |
| ContextLSTMType=Context-to-Vec2022.10 | 0.635 | |
| XLNetType=Contextualized, Representation level=word2022.10 | 0.628 | |
| CBOWType=Static2022.10 | 0.627 | |
| XLNetType=Contextualized, Representation level=token2022.10 | 0.624 | |
| ELMoType=Contextualized, Representation level=word2022.10 | 0.621 | |
| Skip-gramType=Static2022.10 | 0.61 | |
| SynGCNType=Context-to-Vec2022.10 | 0.609 | |
| Skip-gram(context)Type=Static2022.10 | 0.609 | |
| DepsType=Static2022.10 | 0.606 | |
| FASTTEXTDim.=3002021.06 | 0.596 | |
| BERTType=Contextualized, Representation level=avg2022.10 | 0.594 | |
| ELMoType=Contextualized, Representation level=avg2022.10 | 0.583 | |
| GLOVEDim.=3002021.06 | 0.5791 | |
| BERTType=Contextualized, Representation level=token2022.10 | 0.578 | |
| RPAMModel=GPT-2, Template=TP12026.07 | 0.57 | |
| GloVeType=Static2022.10 | 0.542 | |
| ELMoType=Contextualized, Representation level=token2022.10 | 0.541 | |
| Skip-gram(context)Type=Static2022.10 | 0.532 | |
| CBOWDim.=7682021.06 | 0.4999 | |
| ELMoType=Contextualized, Representation level=word2022.10 | 0.455 | |
| GPT2Type=Contextualized, Representation level=word2022.10 | 0.314 | |
| BERTType=Contextualized, Representation level=word2022.10 | 0.31 | |
| GPT2Type=Contextualized, Representation level=word2022.10 | 0.307 | |
| BERTType=Contextualized, Representation level=word2022.10 | 0.24 |