Semantic Textual Similarity on STS-13
76.52Spearman's RhoMIC
Evaluation Results
| Method | Links | |
|---|---|---|
| MICBackbone=BERT, Dimension=7682026.05 | 76.52 | |
| MIPICBackbone=BERT, Dimension=7682026.04 | 73.49 | |
| BERTlarge-flow (target)Backbone=BERT-large, Pooling Strategy=Last 2 layers average, Flow Training Source=Target dataset2020.11 | 73.39 | |
| BERTbase-flow (target)Backbone=BERT-base, Pooling Strategy=Last 2 layers average, Flow Training Source=Target dataset2020.11 | 72.14 | |
| MICBackbone=TinyBERT 6L, Dimension=7682026.05 | 71.59 | |
| Avg. GloVe embeddingsBackbone=GloVe, Pooling Strategy=Average2020.11 | 70.66 | |
| BERTlarge-flow (NLI*)Backbone=BERT-large, Pooling Strategy=Last 2 layers average, Flow Training Source=NLI corpus2020.11 | 66.05 | |
| MICBackbone=BERT, Dimension=162026.05 | 65.31 | |
| BERTbase-flow (NLI*)Backbone=BERT-base, Pooling Strategy=Last 2 layers average, Flow Training Source=NLI corpus2020.11 | 64.69 | |
| MICBackbone=TinyBERT 6L, Dimension=162026.05 | 63.81 | |
| BERTbase-last2avgBackbone=BERT-base, Pooling Strategy=Last 2 layers average2020.11 | 61.95 | |
| BERTlarge-last2avgBackbone=BERT-large, Pooling Strategy=Last 2 layers average2020.11 | 61.37 | |
| Avg. BERT embeddingsBackbone=BERT, Pooling Strategy=Average2020.11 | 57.98 | |
| BERTbaseBackbone=BERT-base, Pooling Strategy=Last layer average2020.11 | 55.92 | |
| BERTlargeBackbone=BERT-large, Pooling Strategy=Last layer average2020.11 | 53.32 | |
| BERT CLS-vectorBackbone=BERT, Pooling Strategy=[CLS]2020.11 | 30.01 |