Semantic Textual Similarity on SICK-R
72.56Spearman Rho (x100)MIPIC
Evaluation Results
| Method | Links | |
|---|---|---|
| MIPICBackbone=BERT, Dimension=7682026.04 | 72.56 | |
| MICBackbone=BERT, Dimension=7682026.05 | 70.81 | |
| MICBackbone=TinyBERT 6L, Dimension=7682026.05 | 70.32 | |
| BERTbase-flow (NLI*)Backbone=BERT-base, Pooling Strategy=Last 2 layers average, Flow Training Source=NLI corpus2020.11 | 65.44 | |
| MICBackbone=BERT, Dimension=162026.05 | 65.31 | |
| BERTlarge-flow (NLI*)Backbone=BERT-large, Pooling Strategy=Last 2 layers average, Flow Training Source=NLI corpus2020.11 | 64.62 | |
| MICBackbone=TinyBERT 6L, Dimension=162026.05 | 64.42 | |
| BERTbase-last2avgBackbone=BERT-base, Pooling Strategy=Last 2 layers average2020.11 | 63.75 | |
| BERTbase-flow (target)Backbone=BERT-base, Pooling Strategy=Last 2 layers average, Flow Training Source=Target dataset2020.11 | 63.11 | |
| BERTlarge-flow (target)Backbone=BERT-large, Pooling Strategy=Last 2 layers average, Flow Training Source=Target dataset2020.11 | 62.5 | |
| BERTlarge-last2avgBackbone=BERT-large, Pooling Strategy=Last 2 layers average2020.11 | 60.22 | |
| Avg. BERT embeddingsBackbone=BERT, Pooling Strategy=Average2020.11 | 58.4 | |
| BERTbaseBackbone=BERT-base, Pooling Strategy=Last layer average2020.11 | 58.21 | |
| Avg. GloVe embeddingsBackbone=GloVe, Pooling Strategy=Average2020.11 | 53.76 | |
| BERTlargeBackbone=BERT-large, Pooling Strategy=Last layer average2020.11 | 53.74 | |
| BERT CLS-vectorBackbone=BERT, Pooling Strategy=[CLS]2020.11 | 42.63 |