Agent Task Performance on Claw-Eval Isolated Mode v1 (test) benchmark leaderboard · SOTA2 Research

Agent Task Performance on Claw-Eval Isolated Mode v1 (test)

64.5Overall Success RateVanilla

Evaluation Results

Method	Links
Vanilla2026.06		64.5	65.4	70.8	45.7	44.4	73.2	70.9	77.7	74	56.8	41	69.2	9.429	4.637	0.216	5.16
TokenPilot2026.06		63.1	68.1	75.4	47	22.3	71.8	65	72	47.8	37	45.6	69.9	4.436	1.154	0.239	2.27
Summary2026.06		62	70	71	32.2	20.6	80	68.5	82.8	49.2	20	41	71.4	2.935	2.871	0.174	3.16
LLMLingua-22026.06		61.9	58.7	67.5	57.6	43.3	62.9	70.1	62.4	61	49.6	44	75.2	8.169	4.043	0.182	4.44
Keep-Last-N2026.06		61.8	67.1	73.8	44.7	21.6	54.5	63.6	86.2	38.4	39.4	55	69.1	4.229	1.845	0.186	2.54
MemOS2026.06		61.6	64.7	74.2	40.9	25.2	71.2	32	73.6	80.2	20	56.2	74.6	12.582	2.709	0.363	4.61
LCM2026.06		61.2	59	67.3	51.1	47.7	65.9	76.6	58.4	58.6	51.4	41.5	72.2	9.776	3.543	0.172	4.17
AgentSwing2026.06		60.9	64.2	66.5	44.1	45.7	67.8	52.8	85.8	57.2	25.6	53.6	68.8	4.58	3.585	0.194	3.91
SelectiveContext2026.06		60.7	59.1	68.2	46.3	36.9	61.5	75.5	59.2	67.2	53.1	44	74.7	8.271	3.862	0.181	4.31
Pichay2026.06		59.3	57.3	62.1	38.2	39.4	68.5	65	91.6	64.1	25.6	55	76.5	4.648	3.944	0.186	4.14
MemoBrain2026.06		58	64.5	60.5	26.1	37.6	56.1	59.9	71	63.4	20	41	75.3	18.182	5.118	0.332	6.69