Semantic Textual Similarity on STS Benchmark Suite

72.24STS-12 ScoreECHO w/ ReverseEOL

Evaluation results

Method
ECHO w/ ReverseEOL2026.06	72.24	84.69	75.15	83.29	81.1	81.98	74.93	79.05
Pretended CoT w/ ReverseEOL2026.06	72.2	85.51	77.51	83.92	82.1	82.8	74.5	79.79
Knowledge w/ ReverseEOL2026.06	71.5	85.56	77.39	83.74	82.3	82.51	75.98	79.85
Pretended CoT w/ ReverseEOL2026.06	71.04	83.28	74.91	81.45	81.51	79.3	73.86	77.91
PromptEOL w/ ReverseEOL2026.06	70.71	84.57	76.14	83.39	80.65	81.72	73.64	78.69
Prompt A w/ ReverseEOL2026.06	70.6	81.23	73.71	81.17	80.14	79.42	74.76	77.29
PromptEOL w/ ReverseEOL2026.06	70.53	82.71	74.66	81.56	81.84	79.6	73.81	77.82
Prompt A w/ ReverseEOL2026.06	70.03	82.53	74.63	82.16	78.74	79.31	75.14	77.51
PromptEOL w/ ReverseEOL2026.06	69.61	82.01	73.8	81.55	79.11	79.13	74.15	77.05
ECHO w/ ReverseEOL2026.06	69.16	82.58	73.52	81.76	79.58	78.83	74.72	77.16
Pretended CoT w/ ReverseEOL2026.06	68.58	80.05	72.59	79.93	77.94	77.26	75.09	75.92
ECHO w/ ReverseEOL2026.06	68.4	80.69	71.63	80.84	78.59	77.78	73.44	75.91
ECHO2026.06	68.12	80.13	71.58	79.3	77.4	77.2	72.76	75.21
Prompt A w/ ReverseEOL2026.06	67.82	82.51	74.72	81.6	79.48	79.2	72.96	76.9
Pretended CoT2026.06	67.76	83.87	74.73	79.94	80.85	79.86	73.59	77.23
ECHO2026.06	67.38	81.08	71.2	78.92	77.61	77.82	72.21	75.17
Pretended CoT w/ ReverseEOL2026.06	67.2	81.3	71.35	80.23	78.55	72.43	67.16	74.03
Knowledge w/ ReverseEOL2026.06	67.18	83.5	74.16	81.27	80.43	76.48	72.36	76.48
Knowledge w/ ReverseEOL2026.06	66.74	79.61	71.55	80.01	75.95	75.96	74.4	74.89
Pretended CoT2026.06	66.71	78.59	71.21	77.12	76.02	77.2	72.81	74.24
PromptEOL2026.06	66.56	80.65	71.74	79.25	77.59	78.74	72.93	75.35
PromptEOL w/ ReverseEOL2026.06	66.46	82.42	72.22	80.24	78.89	73.39	68.33	74.56
Pretended CoT2026.06	66.45	82.04	72.24	77.93	79.36	76.66	71.06	75.11
Prompt A w/ ReverseEOL2026.06	65.95	77.83	67.14	78.06	75.01	73.03	69.55	72.37
Prompt A2026.06	65.74	79.97	73	78.65	78.21	78.19	74.24	75.43
PromptEOL2026.06	65.73	80.77	72.05	78.09	79	77.69	71.22	74.94
Knowledge2026.06	65.6	82.82	74.48	80.75	80.13	80.34	75.89	77.14
Knowledge w/ ReverseEOL2026.06	65.34	83.76	74.72	80.33	79.85	75.14	73.09	76.03
Prompt A2026.06	65.33	80.23	71.69	79.61	75.45	76.75	73.21	74.61
Prompt B w/ ReverseEOL2026.06	65.23	78.89	68.56	78.3	74.77	73.16	68.61	72.5
Prompt B w/ ReverseEOL2026.06	65.16	82.67	72.43	79.81	77.34	74.18	67.13	74.1
PromptEOL2026.06	64.36	82.05	72.21	78.88	77.35	76.8	72.52	74.88
ECHO2026.06	62.97	79.65	69.97	77.11	75.57	76.26	71.65	73.31
Knowledge2026.06	62.76	77.25	69.1	77.64	73.52	74.88	72.43	72.51
ECHO w/ ReverseEOL2026.06	62.48	80.74	68.79	77.21	75.93	68.66	66.53	71.48
Prompt A2026.06	62.26	80.17	71.38	76.93	77	75.86	71.05	73.52
Prompt B2026.06	60.9	77.38	63.29	73.2	73.08	69.79	68.48	69.45
Knowledge2026.06	60.33	81.52	71.73	77.53	77.99	74.09	74.02	73.89
Prompt A2026.06	60	75.89	63.66	75.09	73.07	72.98	69.97	70.09
Knowledge2026.06	59.88	81.9	70.51	78.49	79.53	75.53	71.75	73.94
Pretended CoT2026.06	57.89	78.04	65.02	75.24	76.89	68.3	64.81	69.46
Prompt B w/ ReverseEOL2026.06	57.78	76.6	64.93	74.91	74.79	68.99	67.26	69.32
Prompt B w/ ReverseEOL2026.06	57.29	78.07	64.5	73.1	75.16	62.36	63.37	67.69
PromptEOL2026.06	56.63	79.23	67.03	75.06	76.1	68.62	65.18	69.69
Prompt B2026.06	56.31	79.8	67.32	73.67	71.9	67.44	64.32	68.68
ECHO2026.06	50.87	77.33	61.91	70.62	71.41	61.62	63.76	65.36
Prompt B2026.06	49.59	75.05	61.77	69.38	68.42	63.76	66.03	64.86
Prompt B2026.06	41.47	75.65	59.87	64.44	68.41	48.67	58.71	59.6