Agentic Task Solving on ShellOps benchmark leaderboard · SOTA2 Research

Agentic Task Solving on ShellOps

0.462Pass@3A³

Evaluation Results

Method	Links
A³2026.05		0.462	0.557
A³2026.05		0.427	0.514
GiGPO2026.05		0.223	0.286
GSPO2026.05		0.219	0.277
HGPO2026.05		0.219	0.283
LATS2026.05		0.214	0.277
RetroAgent2026.05		0.171	0.222
ReACT2026.05		0.166	0.206
rStar2026.05		0.138	0.175