Semantic Textual Similarity on MS-COCO CxC annotations 5k (test)
0.74Spearman's R (Avg)PromCSE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PromCSESupervision=supervised, Backbone=BERTbase, Extension=EH2022.03 | 0.74 | 1 | |
| MURALBackbone=BERTbase2022.03 | 0.739 | 0.4 | |
| PromCSESupervision=supervised, Backbone=BERTbase2022.03 | 0.736 | 1 | |
| SimCSESupervision=supervised, Backbone=BERTbase, Extension=EH2022.03 | 0.732 | 1 | |
| SimCSESupervision=supervised, Backbone=BERTbase2022.03 | 0.73 | 1.1 | |
| ALIGNBackbone=BERTbase2022.03 | 0.727 | 0.4 | |
| PromCSESupervision=unsupervised, Backbone=BERTbase2022.03 | 0.712 | 1.1 | |
| DiffCSESupervision=unsupervised, Backbone=BERTbase2022.03 | 0.701 | 1.1 | |
| PromptBERTSupervision=unsupervised, Backbone=BERTbase2022.03 | 0.7 | 1.1 | |
| SimCSESupervision=unsupervised, Backbone=BERTbase2022.03 | 0.675 | 1.2 | |
| GloVe embeddings (avg.)Backbone=GloVe2022.03 | 0.551 | 0.6 |