Semantic Textual Similarity on STS SemEval-2017 Task 1 (test)
0.744Pearson CorrelationENCU
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ENCURank=#12021.06 | 0.744 | — | — | — | — | |
| Cosine baseline2021.06 | 0.6045 | — | — | — | — | |
| MBERTBackbone=MBERT, Training objective=Contrastive (SG-OPT)2021.06 | 0.5852 | — | — | — | — | |
| MBERTBackbone=MBERT, Training objective=Contrastive (SG)2021.06 | 0.5709 | — | — | — | — | |
| MBERTBackbone=MBERT, Training objective=Contrastive (BT)2021.06 | 0.5424 | — | — | — | — | |
| MBERTBackbone=MBERT, Pooling strategy=Mean pooling2021.06 | 0.5109 | — | — | — | — | |
| MBERTBackbone=MBERT, Pooling strategy=WK pooling2021.06 | 0.5038 | — | — | — | — | |
| MBERTBackbone=MBERT, Pooling strategy=CLS2021.06 | 0.3057 | — | — | — | — | |
| S2Match2020.01 | — | 0.25 | 0.1 | 0.55 | 0.53 | |
| SemBleu2020.01 | — | 0.34 | 0.25 | 0.52 | 0.51 | |
| Smatch2020.01 | — | 0.25 | 0.11 | 0.55 | 0.53 |