Semantic Textual Similarity on STS13 (test)
81.26Spearman CorrelationDINO (STS-A-x2)
Evaluation results
| Method | Links | |
|---|---|---|
| DINO (STS-A-x2)supervision=unsupervised, unlabeled_data=STS2021.04 | 81.26 | |
| DINO (STS-A-x1x2)supervision=unsupervised2021.04 | 78.3 | |
| S-BERT (base)supervision=supervised2021.04 | 76.53 | |
| S-ROBERTa (base)supervision=supervised2021.04 | 72.49 | |
| Li et al. (2020)supervision=unsupervised, unlabeled_data=STS2021.04 | 72.14 | |
| Avg. GloVesupervision=unsupervised2021.04 | 70.66 | |
| Zhang et al. (2020)supervision=unsupervised, unlabeled_data=NLI2021.04 | 69.24 | |
| USEsupervision=supervised2021.04 | 67.8 | |
| InferSent, Glovesupervision=supervised2021.04 | 66.75 | |
| Li et al. (2020)supervision=unsupervised, unlabeled_data=NLI2021.04 | 64.69 | |
| Cayley-EncoderBase Model=Gemma2-2B, GNN Variant=GIN2026.03 | 63.98 | |
| Cayley-EncoderBase Model=Llama3-8B, GNN Variant=GIN2026.03 | 63.53 | |
| Cayley-EncoderBase Model=Pythia-410m, GNN Variant=GIN2026.03 | 60.25 | |
| Best-LayerBase Model=Llama3-8B2026.03 | 60.09 | |
| WeightedBase Model=Llama3-8B2026.03 | 59.46 | |
| Best-LayerBase Model=Pythia-410m2026.03 | 59.27 | |
| Best-LayerBase Model=Gemma2-2B2026.03 | 58.56 | |
| Avg. BERTsupervision=unsupervised2021.04 | 57.98 | |
| DWAttBase Model=Llama3-8B2026.03 | 56.26 | |
| FC-EncoderBase Model=Gemma2-2B, GNN Variant=GCN2026.03 | 55.43 | |
| MLP Last-LayerBase Model=Llama3-8B2026.03 | 54.8 | |
| FC-EncoderBase Model=Llama3-8B, GNN Variant=GCN2026.03 | 53.51 | |
| FC-EncoderBase Model=Pythia-410m, GNN Variant=GCN2026.03 | 53 | |
| Set-EncoderBase Model=Llama3-8B2026.03 | 52.8 | |
| Last-LayerBase Model=Llama3-8B2026.03 | 52.66 | |
| Cayley-EncoderBase Model=Pythia-410m, GNN Variant=GCN2026.03 | 51.1 | |
| WeightedBase Model=Pythia-410m2026.03 | 49.49 | |
| DWAttBase Model=Gemma2-2B2026.03 | 48.14 | |
| Cayley-EncoderBase Model=Gemma2-2B, GNN Variant=GCN2026.03 | 47.58 | |
| Last-LayerBase Model=Pythia-410m2026.03 | 47 | |
| FC-EncoderBase Model=Gemma2-2B, GNN Variant=GIN2026.03 | 45.79 | |
| Last-LayerBase Model=Gemma2-2B2026.03 | 45.6 | |
| WeightedBase Model=Gemma2-2B2026.03 | 45.58 | |
| DWAttBase Model=Pythia-410m2026.03 | 44.57 | |
| Set-EncoderBase Model=Pythia-410m2026.03 | 42.68 | |
| Cayley-EncoderBase Model=Llama3-8B, GNN Variant=GCN2026.03 | 42.48 | |
| FC-EncoderBase Model=Pythia-410m, GNN Variant=GIN2026.03 | 40.21 | |
| Set-EncoderBase Model=Gemma2-2B2026.03 | 38.97 | |
| MLP Last-LayerBase Model=Gemma2-2B2026.03 | 36.93 | |
| MLP Last-LayerBase Model=Pythia-410m2026.03 | 36.16 | |
| FC-EncoderBase Model=Llama3-8B, GNN Variant=GIN2026.03 | 34.04 | |
| BERT CLSsupervision=unsupervised2021.04 | 30.01 |