Semantic Relatedness research benchmarks

Benchmarks

Dataset NameSOTA methodMetricTrendResultsLast Updated

SICK 2014 (test)

InferSent

0.884Pearson's r

Feb 27, 2026

BEIR Semantic Relatedness Tasks (test)

SPLADEV2

47.9ArguAna Score

Mar 27, 2026

UMNS n=566 (full)

BERT-CRel

0.708Spearman Correlation

Feb 26, 2026

SICK

TREE-LSTM

0.868Pearson r

Feb 26, 2026

UMNR n=587 (full)

BERT-CRel

0.643Spearman's Correlation

Feb 26, 2026

HLTK n=36 (full)

fastText+

0.846Spearman's Correlation

Feb 26, 2026

PDSP n=30 (full)

BERT-CRel

0.85Spearman's Correlation

Feb 26, 2026

MMYC n=29 (full)

BERT-CRel

0.857Spearman's Correlation

Feb 26, 2026

MMYP n=29 (full)

BERT-CRel

0.89Spearman Correlation

Feb 26, 2026

MAYO n=101 (full)

BERT-CRel

0.695Spearman Correlation

Feb 26, 2026

PDSC n=30 (full)

BERT-CRel

0.849Spearman Correlation

Feb 26, 2026

SICK (test)

JMTall

0.233MSE

Feb 26, 2026

SICK filtered 2014 (test)

S2Match

0.24RMSE

Feb 26, 2026