Web Shopping Agent on WebShop OOD v1.0
42.1Access Success RateSKILL0
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| SKILL0Method Category=Skill-Augmented RL Methods2026.05 | 42.1 | 38.6 | 26.5 | 35.4 | |
| Skill0.5Method Category=Skill-Augmented RL Methods2026.05 | 36.6 | 54.2 | 31.4 | 40.6 | |
| SkillRLMethod Category=Skill-Augmented RL Methods2026.05 | 36.3 | 48.5 | 27.6 | 36.7 | |
| SLIMMethod Category=Skill-Augmented RL Methods2026.05 | 35 | 29.6 | 35.6 | 33.8 | |
| RLOOMethod Category=RL-based Methods2026.05 | 31.4 | 46.5 | 22.5 | 32.9 | |
| GRPOMethod Category=RL-based Methods2026.05 | 27.7 | 47.3 | 25.9 | 32.3 | |
| EvolveRMethod Category=Memory-Augmented RL Methods2026.05 | 20.8 | 28.6 | 18.2 | 21.9 | |
| Few-shotMethod Category=Prompt-based Methods2026.05 | 18.8 | 29.6 | 5.5 | 16.9 | |
| MemPMethod Category=Prompt-based Agentic or Memory-based Methods2026.05 | 16.2 | 14.8 | 9.6 | 13.5 | |
| SimpleMem+GRPOMethod Category=Memory-Augmented RL Methods2026.05 | 16.2 | 32.1 | 29.4 | 25 | |
| MemRLMethod Category=Memory-Augmented RL Methods2026.05 | 13.2 | 17.9 | 27.8 | 19.6 | |
| ExpeLMethod Category=Prompt-based Agentic or Memory-based Methods2026.05 | 12.5 | 25.9 | 8.2 | 14.5 | |
| ReActMethod Category=Prompt-based Agentic or Memory-based Methods2026.05 | 11.2 | 24.1 | 2.7 | 11.6 | |
| Mem0+GRPOMethod Category=Memory-Augmented RL Methods2026.05 | 10.2 | 32.1 | 30.2 | 23 | |
| Mem0Method Category=Prompt-based Agentic or Memory-based Methods2026.05 | 10 | 16.7 | 4.1 | 9.7 | |
| SimpleMemMethod Category=Prompt-based Agentic or Memory-based Methods2026.05 | 10 | 20.4 | 5.5 | 11.1 | |
| ReflexionMethod Category=Prompt-based Agentic or Memory-based Methods2026.05 | 6.3 | 5.6 | 1.4 | 4.4 | |
| Zero-shotMethod Category=Prompt-based Methods2026.05 | 2.5 | 3.7 | 5.5 | 3.9 |