Semantic Textual Similarity on STS-15
0.7662Spearman's RhoMIC
Evaluation results
| Method | Links | |
|---|---|---|
| MICBackbone=BERT, Dimension=7682026.05 | 0.7662 | |
| MICBackbone=TinyBERT 6L, Dimension=7682026.05 | 0.7623 | |
| BERTlarge-flow (target)Backbone=BERT-large, Pooling Strategy=Last 2 layers average, Flow Training Source=Target dataset2020.11 | 0.7492 | |
| BERTlarge-flow (NLI*)Backbone=BERT-large, Pooling Strategy=Last 2 layers average, Flow Training Source=NLI corpus2020.11 | 0.7487 | |
| BERTbase-flow (target)Backbone=BERT-base, Pooling Strategy=Last 2 layers average, Flow Training Source=Target dataset2020.11 | 0.7377 | |
| BERTbase-flow (NLI*)Backbone=BERT-base, Pooling Strategy=Last 2 layers average, Flow Training Source=NLI corpus2020.11 | 0.7292 | |
| BERTbase-last2avgBackbone=BERT-base, Pooling Strategy=Last 2 layers average2020.11 | 0.7095 | |
| Avg. GloVe embeddingsBackbone=GloVe, Pooling Strategy=Average2020.11 | 0.6825 | |
| BERTlarge-last2avgBackbone=BERT-large, Pooling Strategy=Last 2 layers average2020.11 | 0.6804 | |
| MICBackbone=BERT, Dimension=162026.05 | 0.6692 | |
| MICBackbone=TinyBERT 6L, Dimension=162026.05 | 0.6547 | |
| Avg. BERT embeddingsBackbone=BERT, Pooling Strategy=Average2020.11 | 0.6315 | |
| BERTbaseBackbone=BERT-base, Pooling Strategy=Last layer average2020.11 | 0.6275 | |
| BERTlargeBackbone=BERT-large, Pooling Strategy=Last layer average2020.11 | 0.5654 | |
| BERT CLS-vectorBackbone=BERT, Pooling Strategy=[CLS]2020.11 | 0.3688 |