Context Management and LLM Evaluation on PinchBench Continuous Mode benchmark leaderboard · SOTA2 Research

Context Management and LLM Evaluation on PinchBench Continuous Mode

81.3Overall ScoreTokenPilot

Evaluation Results

Method	Links
TokenPilot2026.06		81.3	76.7	76.9	90.6	84.1	86	85.6	89.1	73.6	95	77.2	80.1	8.551	1.549	0.219	2.79
MemOS2026.06		80.9	87.5	59	85.4	87.1	82	81	95	78.1	92.5	87.4	84.1	30.859	8.939	0.308	10.41
Vanilla2026.06		79.2	83.5	58.4	86.8	80	78.5	87.8	94.6	77.6	95	55.8	83.6	25.015	5.943	0.202	7.24
Keep-Last-N2026.06		79.1	86.3	67	87.8	87	77	85.4	77.3	75.9	95	56.8	75.1	18.117	4.481	0.209	5.66
AgentSwing2026.06		78.5	86.3	67.3	89	79.1	82.4	87.4	68.1	72.4	93.8	61.7	83.8	12.68	5.476	0.314	6.47
Summary2026.06		78.4	89.1	64.4	73.8	82.9	69.6	81.6	93.6	80.3	95	61.7	75.3	20.687	6.249	0.196	7.12
MemoBrain2026.06		78	87.7	65	85.5	84.9	75.9	81	89	72.3	90.3	86.6	84.7	12.917	2.283	0.232	3.73
LCM2026.06		77	88.1	63.2	90.1	75.7	78.5	85.4	88.9	65.1	82.8	80.8	78.2	18.708	2.417	0.222	4.21
Pichay2026.06		76.5	88	66.7	76.2	81	77.6	83.5	84.2	67.6	100	63.8	75.3	11.698	6.874	0.26	7.2
SelectiveContext2026.06		74	85.4	64.2	83.1	75.4	78.8	77.3	91.2	62.2	89.5	71	80.3	25.475	2.608	0.196	4.75
LLMLingua-22026.06		73.8	85.8	58.4	80.3	74.3	79.6	82.8	84.2	63.4	90	79.1	83.6	20.574	2.183	0.194	4.06