List your company
ResearchFormerly WizWand

Semantic Textual Similarity on SICK-R

72.56Spearman Rho (x100)MIPIC
41.432849.513957.59565.6761Nov 2, 2020Oct 6, 2021Sep 10, 2022Aug 15, 2023Jul 19, 2024Jun 23, 2025May 28, 2026
Updated 5mo ago

Evaluation results

MethodLinks
MIPICBackbone=BERT, Dimension=7682026.0472.56
MICBackbone=BERT, Dimension=7682026.0570.81
MICBackbone=TinyBERT 6L, Dimension=7682026.0570.32
BERTbase-flow (NLI*)Backbone=BERT-base, Pooling Strategy=Last 2 layers average, Flow Training Source=NLI corpus2020.1165.44
MICBackbone=BERT, Dimension=162026.0565.31
BERTlarge-flow (NLI*)Backbone=BERT-large, Pooling Strategy=Last 2 layers average, Flow Training Source=NLI corpus2020.1164.62
MICBackbone=TinyBERT 6L, Dimension=162026.0564.42
BERTbase-last2avgBackbone=BERT-base, Pooling Strategy=Last 2 layers average2020.1163.75
BERTbase-flow (target)Backbone=BERT-base, Pooling Strategy=Last 2 layers average, Flow Training Source=Target dataset2020.1163.11
BERTlarge-flow (target)Backbone=BERT-large, Pooling Strategy=Last 2 layers average, Flow Training Source=Target dataset2020.1162.5
BERTlarge-last2avgBackbone=BERT-large, Pooling Strategy=Last 2 layers average2020.1160.22
Avg. BERT embeddingsBackbone=BERT, Pooling Strategy=Average2020.1158.4
BERTbaseBackbone=BERT-base, Pooling Strategy=Last layer average2020.1158.21
Avg. GloVe embeddingsBackbone=GloVe, Pooling Strategy=Average2020.1153.76
BERTlargeBackbone=BERT-large, Pooling Strategy=Last layer average2020.1153.74
BERT CLS-vectorBackbone=BERT, Pooling Strategy=[CLS]2020.1142.63