Sentence Relatedness on STS 2014 (Domain Correlations)

0.69News SpearmanCPHRASE

Evaluation results

Method
CPHRASE2016.02	0.69	0.71	0.43	0.41	0.76	0.73	0.6	0.65	0.75	0.79	0.6	0.65	0.65	0.67
Fixed NTEE2017.05	0.69	0.72	0.46	0.47	0.78	0.75	0.67	0.74	0.74	0.78	0.61	0.65	—	—
Fixed NTEE2017.05	0.69	0.72	0.47	0.47	0.78	0.75	0.67	0.73	0.74	0.77	0.61	0.65	—	—
NTEE2017.05	0.68	0.74	0.55	0.56	0.74	0.72	0.66	0.75	0.77	0.82	0.63	0.69	—	—
NTEE2017.05	0.68	0.74	0.51	0.52	0.69	0.66	0.66	0.74	0.72	0.77	0.61	0.68	—	—
Skip-gram2017.05	0.67	0.65	0.39	0.36	0.69	0.62	0.66	0.65	0.56	0.54	0.6	0.62	—	—
DictRep BOW+embs.2016.02	0.65	0.72	0.49	0.47	0.85	0.86	0.67	0.72	0.71	0.74	0.57	0.61	0.67	0.7
Skip-gram2017.05	0.65	0.63	0.39	0.36	0.69	0.61	0.62	0.62	0.57	0.56	0.58	0.6	—	—
DictRep BOW2016.02	0.62	0.67	0.42	0.4	0.81	0.81	0.62	0.66	0.66	0.68	0.53	0.58	0.62	0.65
CBOW2017.05	0.59	0.58	0.36	0.35	0.64	0.57	0.68	0.7	0.55	0.54	0.53	0.57	—	—
FastSent2016.02	0.58	0.59	0.41	0.36	0.74	0.7	0.63	0.66	0.74	0.78	0.57	0.59	0.63	0.64
Siamese CBOW2017.05	0.58	0.59	0.42	0.41	0.66	0.61	0.71	0.73	0.65	0.65	0.63	0.64	—	—
CBOW2016.02	0.57	0.61	0.43	0.44	0.72	0.69	0.71	0.75	0.71	0.73	0.55	0.59	0.64	0.65
Skipgram2016.02	0.56	0.59	0.42	0.42	0.73	0.7	0.71	0.74	0.65	0.67	0.55	0.58	0.62	0.63
FastSent+AE2016.02	0.56	0.59	0.41	0.4	0.69	0.64	0.7	0.74	0.63	0.65	0.58	0.6	0.62	0.62
SAE+embs.2016.02	0.52	0.54	0.22	0.23	0.6	0.55	0.6	0.6	0.64	0.64	0.41	0.41	0.42	0.43
SDAE+embs.2016.02	0.51	0.54	0.29	0.29	0.56	0.5	0.57	0.58	0.59	0.59	0.43	0.44	0.37	0.38
DictRep RNN+embs.2016.02	0.51	0.6	0.29	0.27	0.8	0.81	0.44	0.47	0.65	0.7	0.42	0.46	0.54	0.57
Unigram TFIDF2016.02	0.48	0.48	0.4	0.38	0.6	0.59	0.63	0.65	0.72	0.74	0.49	0.49	0.58	0.57
NMT En to De2016.02	0.47	0.43	0.26	0.25	0.34	0.31	0.49	0.45	0.44	0.43	0.38	0.37	0.4	0.38
SkipThought2016.02	0.44	0.45	0.14	0.15	0.39	0.34	0.42	0.43	0.55	0.6	0.43	0.44	0.27	0.29
Skip-thought2017.05	0.44	0.45	0.14	0.15	0.39	0.34	0.42	0.43	0.55	0.6	0.43	0.44	—	—
Paragraph Vec DM2016.02	0.42	0.46	0.33	0.34	0.51	0.48	0.54	0.57	0.32	0.3	0.46	0.47	0.44	0.44
DictRep RNN2016.02	0.4	0.46	0.26	0.23	0.78	0.78	0.42	0.42	0.56	0.56	0.38	0.4	0.49	0.5
NMT En to Fr2016.02	0.35	0.32	0.18	0.18	0.47	0.43	0.55	0.53	0.44	0.45	0.43	0.43	0.43	0.42
Paragraph Vec DBOW2016.02	0.31	0.34	0.32	0.32	0.53	0.5	0.43	0.46	0.46	0.44	0.39	0.41	0.42	0.43
CaptionRep BOW2016.02	0.26	0.26	0.29	0.22	0.5	0.35	0.37	0.31	0.78	0.81	0.39	0.36	0.46	0.42
SAE2016.02	0.17	0.16	0.12	0.12	0.3	0.23	0.28	0.22	0.49	0.46	0.13	0.11	0.12	0.13
SDAE2016.02	0.07	0.04	0.11	0.13	0.33	0.24	0.44	0.42	0.44	0.38	0.36	0.36	0.17	0.15
CaptionRep RNN2016.02	0.05	0.05	0.13	0.09	0.4	0.33	0.36	0.3	0.76	0.82	0.3	0.28	0.39	0.36