Multi-objective Evaluation on Local Wiki Search benchmark leaderboard · SOTA2 Research

Multi-objective Evaluation on Local Wiki Search

61.3F1 (2-objective)HiMPO

Evaluation Results

Method	Links
HiMPO2026.06		61.3	51	47.5	36.8	35.1	27.2	31.9	24.4	25.1	18.6	40.2	31.6	1.2	0.2
SUPO2026.06		57.9	47.2	43	31.8	30.3	24	22.7	17.5	16.3	11.6	34	26.4	1.4	0.2
MEMPO2026.06		56.5	46.2	42.8	31.9	34.3	26.9	30.5	23.7	24.2	18.2	37.6	29.4	1.2	0.2
MemPO2026.02		56.47	46.15	42.75	31.9	34.32	26.93	30.48	23.7	24.15	18.16	37.63	29.37	1.18	0.18
GRPO2026.06		54.6	43	38.3	28.6	29.8	22.6	19	13.7	11	7.8	30.5	23.1	4.4	0.8
GRPO (w/o <mem>)2026.02		54.57	42.95	38.31	28.6	29.78	22.6	18.97	13.65	11.01	7.84	30.53	23.13	4.39	0.81
MEM12026.02		47.74	37.1	26.51	18.9	18.81	14.07	19.04	13.55	19.61	13.36	26.34	19.4	1.38	0.2
MEM12026.06		47.7	37.1	26.5	18.9	18.8	14.1	19	13.6	19.6	13.4	26.3	19.4	1.4	0.2
ReSearch2026.02		47.4	36	24.13	16.7	20.84	15.93	10.8	7.7	5.08	3.56	21.65	15.98	3.29	0.71
ReSearch2026.06		47.4	36	24.1	16.7	20.8	15.9	10.8	7.7	5.1	3.6	21.7	16	3.3	0.7
Qwen2.5 (ReAct)2026.02		33.73	25.6	10.59	7	5.37	4	5.92	4.25	2.63	1.96	11.65	8.56	3.64	0.61
ReAct2026.06		33.7	25.6	10.6	7	5.4	4	5.9	4.3	2.6	2	11.7	8.6	3.6	0.6
A-MEM2026.02		33.24	25.2	13.71	10.1	9.8	7.07	6.86	5.1	5.56	3.6	13.83	10.21	2.62	0.38
A-MEM2026.06		33.2	25.2	13.7	10.1	9.8	7.1	6.9	5.1	5.6	3.6	13.8	10.2	2.6	0.4
DeepResearcher2026.02		30.94	24.7	24.52	18.1	13.88	10.73	9.12	6.85	5.07	3.52	16.71	12.78	4.29	0.77
DeepResearcher2026.06		30.9	24.7	24.5	18.1	13.9	10.7	9.1	6.9	5.1	3.5	16.7	12.8	4.3	0.8