Sentence Relatedness on STS 2014 (Domain Correlations) benchmark leaderboard · SOTA2 Research

Sentence Relatedness on STS 2014 (Domain Correlations)

0.69News SpearmanCPHRASE

Evaluation Results

Method	Links
CPHRASE2016.02		0.69	0.71	0.43	0.41	0.76	0.73	0.6	0.65	0.75	0.79	0.6	0.65	0.65	0.67
Fixed NTEE2017.05		0.69	0.72	0.46	0.47	0.78	0.75	0.67	0.74	0.74	0.78	0.61	0.65	—	—
Fixed NTEE2017.05		0.69	0.72	0.47	0.47	0.78	0.75	0.67	0.73	0.74	0.77	0.61	0.65	—	—
NTEE2017.05		0.68	0.74	0.55	0.56	0.74	0.72	0.66	0.75	0.77	0.82	0.63	0.69	—	—
NTEE2017.05		0.68	0.74	0.51	0.52	0.69	0.66	0.66	0.74	0.72	0.77	0.61	0.68	—	—
Skip-gram2017.05		0.67	0.65	0.39	0.36	0.69	0.62	0.66	0.65	0.56	0.54	0.6	0.62	—	—
DictRep BOW+embs.2016.02		0.65	0.72	0.49	0.47	0.85	0.86	0.67	0.72	0.71	0.74	0.57	0.61	0.67	0.7
Skip-gram2017.05		0.65	0.63	0.39	0.36	0.69	0.61	0.62	0.62	0.57	0.56	0.58	0.6	—	—
DictRep BOW2016.02		0.62	0.67	0.42	0.4	0.81	0.81	0.62	0.66	0.66	0.68	0.53	0.58	0.62	0.65
CBOW2017.05		0.59	0.58	0.36	0.35	0.64	0.57	0.68	0.7	0.55	0.54	0.53	0.57	—	—
FastSent2016.02		0.58	0.59	0.41	0.36	0.74	0.7	0.63	0.66	0.74	0.78	0.57	0.59	0.63	0.64
Siamese CBOW2017.05		0.58	0.59	0.42	0.41	0.66	0.61	0.71	0.73	0.65	0.65	0.63	0.64	—	—
CBOW2016.02		0.57	0.61	0.43	0.44	0.72	0.69	0.71	0.75	0.71	0.73	0.55	0.59	0.64	0.65
Skipgram2016.02		0.56	0.59	0.42	0.42	0.73	0.7	0.71	0.74	0.65	0.67	0.55	0.58	0.62	0.63
FastSent+AE2016.02		0.56	0.59	0.41	0.4	0.69	0.64	0.7	0.74	0.63	0.65	0.58	0.6	0.62	0.62
SAE+embs.2016.02		0.52	0.54	0.22	0.23	0.6	0.55	0.6	0.6	0.64	0.64	0.41	0.41	0.42	0.43
SDAE+embs.2016.02		0.51	0.54	0.29	0.29	0.56	0.5	0.57	0.58	0.59	0.59	0.43	0.44	0.37	0.38
DictRep RNN+embs.2016.02		0.51	0.6	0.29	0.27	0.8	0.81	0.44	0.47	0.65	0.7	0.42	0.46	0.54	0.57
Unigram TFIDF2016.02		0.48	0.48	0.4	0.38	0.6	0.59	0.63	0.65	0.72	0.74	0.49	0.49	0.58	0.57
NMT En to De2016.02		0.47	0.43	0.26	0.25	0.34	0.31	0.49	0.45	0.44	0.43	0.38	0.37	0.4	0.38
SkipThought2016.02		0.44	0.45	0.14	0.15	0.39	0.34	0.42	0.43	0.55	0.6	0.43	0.44	0.27	0.29
Skip-thought2017.05		0.44	0.45	0.14	0.15	0.39	0.34	0.42	0.43	0.55	0.6	0.43	0.44	—	—
Paragraph Vec DM2016.02		0.42	0.46	0.33	0.34	0.51	0.48	0.54	0.57	0.32	0.3	0.46	0.47	0.44	0.44
DictRep RNN2016.02		0.4	0.46	0.26	0.23	0.78	0.78	0.42	0.42	0.56	0.56	0.38	0.4	0.49	0.5
NMT En to Fr2016.02		0.35	0.32	0.18	0.18	0.47	0.43	0.55	0.53	0.44	0.45	0.43	0.43	0.43	0.42
Paragraph Vec DBOW2016.02		0.31	0.34	0.32	0.32	0.53	0.5	0.43	0.46	0.46	0.44	0.39	0.41	0.42	0.43
CaptionRep BOW2016.02		0.26	0.26	0.29	0.22	0.5	0.35	0.37	0.31	0.78	0.81	0.39	0.36	0.46	0.42
SAE2016.02		0.17	0.16	0.12	0.12	0.3	0.23	0.28	0.22	0.49	0.46	0.13	0.11	0.12	0.13
SDAE2016.02		0.07	0.04	0.11	0.13	0.33	0.24	0.44	0.42	0.44	0.38	0.36	0.36	0.17	0.15
CaptionRep RNN2016.02		0.05	0.05	0.13	0.09	0.4	0.33	0.36	0.3	0.76	0.82	0.3	0.28	0.39	0.36