STS
Benchmarks
TaskDatasetSOTA resultTrendResults
STS tasks (STS12, STS13, STS14, STS15, STS16, STS-B, SICK-R)
80.67STS12 Score
253
STS-12
0.715Spearman Correlation (rho)
91
English STS
83.07Average Score
68
STS (Semantic Textual Similarity) 2012-2016 (test)
81.08STS-12 Score
57
STS (Semantic Textual Similarity) Benchmark Suite
72.24STS-12 Score
48
STS Benchmark (test)
0.919Pearson Correlation (r)
46
STS16 (test)
77.18Spearman Corr
42
STS15 (test)
0.805Spearman Correlation
42
STS14 (test)
0.732Spearman Correlation
42
STS13 (test)
81.26Spearman Correlation
42
STS 2014
66.93Spearman Correlation
39
STS12 (test)
65.31Similarity Score
30
STS 2014
0.69News Spearman
30
STS motion
0.047RMSE (deg)
20
STS tasks (test)
72.38STS12 Score
20
STS12
4.34Leakage
16
STS-16
77.63Spearman Rho (x100)
16
STS-13
76.52Spearman's Rho
16
STS-15
0.766Spearman's Rho
15
STS22
76.55Pearson Correlation
14
STS hye
71.23Score
13
STS X-ray (unseen)
73.2DSC
10
STS (test)
60.33IoU
9
STS English (test)
76.9Spearman's ρ
9
STS SemEval-2017 Task 1 (test)
0.744Pearson Correlation
8