Context Management and LLM Evaluation on PinchBench Isolated Mode benchmark leaderboard · SOTA2 Research

Context Management and LLM Evaluation on PinchBench Isolated Mode

81Overall ScoreTokenPilot

Evaluation Results

Method	Links
TokenPilot2026.06		81	89	71.2	80	72.6	88.9	85.3	95.2	79.4	95	95.2	58	8.893	1.933	0.244	3.22
Vanilla2026.06		80.5	87.2	68.7	84.1	86	75.1	83	94.7	81.4	86.5	70.3	55.3	6.184	8.753	0.285	8.31
Keep-Last-N2026.06		80.4	86	70	82.4	80.1	77.6	78.3	91.5	84.3	92.5	70.1	87.8	12.813	2.657	0.291	4.26
Summary2026.06		79.5	80.7	66.3	83.5	77.9	82.1	87.5	77.2	81.3	92.5	67.2	54.4	12.303	3.009	0.296	4.51
MemOS2026.06		79.4	84.2	54.4	83.1	82.3	78.2	81.1	97.2	77.6	92.5	85.9	80.2	29.018	4.573	0.492	7.81
Pichay2026.06		78.9	85.4	58.9	71.8	79	88.3	79.8	83.6	84	91.3	69.8	63.3	6.717	3.333	0.238	4.07
AgentSwing2026.06		78.4	89.8	71.9	80.2	79.5	83.5	80.8	83.7	77.9	92.5	65.7	35	4.534	7.129	0.241	6.77
MemoBrain2026.06		78.1	86.8	62.1	88.9	85.7	82.6	88.3	85.4	63.6	92.5	76.1	69.7	10.2	2.107	0.233	3.36
LCM2026.06		77.8	90.1	64.9	79.6	85.4	81.3	81	87.1	67.5	85	81.7	80.6	16.018	3.064	0.356	5.1
LLMLingua-22026.06		76.9	89.3	64	82.1	86.9	80.8	79.6	84.4	66.3	85	79.6	72.1	14.241	3.975	0.384	5.78
SelectiveContext2026.06		76.5	88.5	64.5	73	83.7	82.6	81.1	92.8	63.3	86.9	82.8	77.2	11.273	4.642	0.324	5.79