Semantic Textual Similarity on STS15 (test)
0.8049Spearman CorrelationDINO (STS-A-x2)
Evaluation Results
| Method | Links | |
|---|---|---|
| DINO (STS-A-x2)supervision=unsupervised, unlabeled_data=STS2021.04 | 0.8049 | |
| DINO (STS-A-x1x2)supervision=unsupervised2021.04 | 0.796 | |
| S-BERT (base)supervision=supervised2021.04 | 0.7909 | |
| S-ROBERTa (base)supervision=supervised2021.04 | 0.7874 | |
| Cayley-EncoderBase Model=Llama3-8B, GNN Variant=GIN2026.03 | 0.7696 | |
| USEsupervision=supervised2021.04 | 0.7683 | |
| Zhang et al. (2020)supervision=unsupervised, unlabeled_data=NLI2021.04 | 0.7523 | |
| FC-EncoderBase Model=Gemma2-2B, GNN Variant=GCN2026.03 | 0.7468 | |
| Cayley-EncoderBase Model=Gemma2-2B, GNN Variant=GIN2026.03 | 0.7394 | |
| Li et al. (2020)supervision=unsupervised, unlabeled_data=STS2021.04 | 0.7377 | |
| FC-EncoderBase Model=Llama3-8B, GNN Variant=GCN2026.03 | 0.7369 | |
| Li et al. (2020)supervision=unsupervised, unlabeled_data=NLI2021.04 | 0.7292 | |
| InferSent, Glovesupervision=supervised2021.04 | 0.7277 | |
| Cayley-EncoderBase Model=Gemma2-2B, GNN Variant=GCN2026.03 | 0.708 | |
| Avg. GloVesupervision=unsupervised2021.04 | 0.6825 | |
| DWAttBase Model=Gemma2-2B2026.03 | 0.6773 | |
| WeightedBase Model=Llama3-8B2026.03 | 0.673 | |
| FC-EncoderBase Model=Gemma2-2B, GNN Variant=GIN2026.03 | 0.6722 | |
| Cayley-EncoderBase Model=Pythia-410m, GNN Variant=GIN2026.03 | 0.6699 | |
| Best-LayerBase Model=Llama3-8B2026.03 | 0.6689 | |
| DWAttBase Model=Llama3-8B2026.03 | 0.66 | |
| Best-LayerBase Model=Pythia-410m2026.03 | 0.6559 | |
| Best-LayerBase Model=Gemma2-2B2026.03 | 0.6549 | |
| FC-EncoderBase Model=Pythia-410m, GNN Variant=GCN2026.03 | 0.6394 | |
| FC-EncoderBase Model=Llama3-8B, GNN Variant=GIN2026.03 | 0.6327 | |
| Avg. BERTsupervision=unsupervised2021.04 | 0.6315 | |
| MLP Last-LayerBase Model=Llama3-8B2026.03 | 0.6119 | |
| Cayley-EncoderBase Model=Pythia-410m, GNN Variant=GCN2026.03 | 0.6051 | |
| Last-LayerBase Model=Llama3-8B2026.03 | 0.5807 | |
| Set-EncoderBase Model=Llama3-8B2026.03 | 0.5612 | |
| WeightedBase Model=Gemma2-2B2026.03 | 0.5488 | |
| FC-EncoderBase Model=Pythia-410m, GNN Variant=GIN2026.03 | 0.5454 | |
| WeightedBase Model=Pythia-410m2026.03 | 0.5372 | |
| DWAttBase Model=Pythia-410m2026.03 | 0.5251 | |
| Cayley-EncoderBase Model=Llama3-8B, GNN Variant=GCN2026.03 | 0.5246 | |
| MLP Last-LayerBase Model=Gemma2-2B2026.03 | 0.5238 | |
| Set-EncoderBase Model=Gemma2-2B2026.03 | 0.5051 | |
| Last-LayerBase Model=Gemma2-2B2026.03 | 0.5022 | |
| Last-LayerBase Model=Pythia-410m2026.03 | 0.4932 | |
| Set-EncoderBase Model=Pythia-410m2026.03 | 0.4832 | |
| MLP Last-LayerBase Model=Pythia-410m2026.03 | 0.3775 | |
| BERT CLSsupervision=unsupervised2021.04 | 0.3688 |