Semantic Textual Similarity on STS14 (test)
0.7319Spearman CorrelationS-BERT (base)
Evaluation results
| Method | Links | |
|---|---|---|
| S-BERT (base)supervision=supervised2021.04 | 0.7319 | |
| DINO (STS-A-x2)supervision=unsupervised, unlabeled_data=STS2021.04 | 0.7125 | |
| S-ROBERTa (base)supervision=supervised2021.04 | 0.708 | |
| Cayley-EncoderBase Model=Llama3-8B, GNN Variant=GIN2026.03 | 0.7017 | |
| Li et al. (2020)supervision=unsupervised, unlabeled_data=STS2021.04 | 0.6842 | |
| DINO (STS-A-x1x2)supervision=unsupervised2021.04 | 0.6638 | |
| Li et al. (2020)supervision=unsupervised, unlabeled_data=NLI2021.04 | 0.6466 | |
| USEsupervision=supervised2021.04 | 0.6461 | |
| Cayley-EncoderBase Model=Gemma2-2B, GNN Variant=GIN2026.03 | 0.6459 | |
| FC-EncoderBase Model=Gemma2-2B, GNN Variant=GCN2026.03 | 0.6389 | |
| InferSent, Glovesupervision=supervised2021.04 | 0.6215 | |
| Zhang et al. (2020)supervision=unsupervised, unlabeled_data=NLI2021.04 | 0.6121 | |
| FC-EncoderBase Model=Llama3-8B, GNN Variant=GCN2026.03 | 0.5988 | |
| Avg. GloVesupervision=unsupervised2021.04 | 0.5973 | |
| DWAttBase Model=Llama3-8B2026.03 | 0.5863 | |
| Avg. BERTsupervision=unsupervised2021.04 | 0.5798 | |
| Cayley-EncoderBase Model=Gemma2-2B, GNN Variant=GCN2026.03 | 0.5786 | |
| Cayley-EncoderBase Model=Pythia-410m, GNN Variant=GIN2026.03 | 0.5665 | |
| DWAttBase Model=Gemma2-2B2026.03 | 0.5529 | |
| WeightedBase Model=Llama3-8B2026.03 | 0.549 | |
| Best-LayerBase Model=Llama3-8B2026.03 | 0.5462 | |
| Cayley-EncoderBase Model=Pythia-410m, GNN Variant=GCN2026.03 | 0.526 | |
| Best-LayerBase Model=Gemma2-2B2026.03 | 0.5243 | |
| Set-EncoderBase Model=Llama3-8B2026.03 | 0.52 | |
| FC-EncoderBase Model=Pythia-410m, GNN Variant=GCN2026.03 | 0.5176 | |
| Best-LayerBase Model=Pythia-410m2026.03 | 0.5161 | |
| Cayley-EncoderBase Model=Llama3-8B, GNN Variant=GCN2026.03 | 0.4851 | |
| DWAttBase Model=Pythia-410m2026.03 | 0.4746 | |
| FC-EncoderBase Model=Gemma2-2B, GNN Variant=GIN2026.03 | 0.4477 | |
| WeightedBase Model=Pythia-410m2026.03 | 0.4421 | |
| MLP Last-LayerBase Model=Llama3-8B2026.03 | 0.4408 | |
| Set-EncoderBase Model=Pythia-410m2026.03 | 0.4399 | |
| Last-LayerBase Model=Llama3-8B2026.03 | 0.4288 | |
| Last-LayerBase Model=Pythia-410m2026.03 | 0.4145 | |
| WeightedBase Model=Gemma2-2B2026.03 | 0.3814 | |
| FC-EncoderBase Model=Llama3-8B, GNN Variant=GIN2026.03 | 0.3766 | |
| Last-LayerBase Model=Gemma2-2B2026.03 | 0.3758 | |
| Set-EncoderBase Model=Gemma2-2B2026.03 | 0.3505 | |
| FC-EncoderBase Model=Pythia-410m, GNN Variant=GIN2026.03 | 0.3379 | |
| MLP Last-LayerBase Model=Pythia-410m2026.03 | 0.3328 | |
| MLP Last-LayerBase Model=Gemma2-2B2026.03 | 0.3132 | |
| BERT CLSsupervision=unsupervised2021.04 | 0.2009 |