E-commerce Agentic Decision-making on WebShop
89.8ScoreG2PO
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| G2POType=RL Training, Backbone=Qwen2.5-7B-Instruct2026.06 | 89.8 | 78.3 | |
| GiGPOType=RL Training, Backbone=Qwen2.5-7B-Instruct2026.06 | 86.2 | 75.2 | |
| G2POType=RL Training, Backbone=Qwen2.5-1.5B-Instruct2026.06 | 85.1 | 71.2 | |
| GiGPOType=RL Training, Backbone=Qwen2.5-1.5B-Instruct2026.06 | 83.5 | 67.4 | |
| PPO (with critic)Type=RL Training, Backbone=Qwen2.5-7B-Instruct2026.06 | 81.4 | 68.7 | |
| RLOOType=RL Training, Backbone=Qwen2.5-7B-Instruct2026.06 | 80.3 | 65.7 | |
| GRPOType=RL Training, Backbone=Qwen2.5-7B-Instruct2026.06 | 79.3 | 66.1 | |
| GRPOType=RL Training, Backbone=Qwen2.5-1.5B-Instruct2026.06 | 75.8 | 56.8 | |
| RLOOType=RL Training, Backbone=Qwen2.5-1.5B-Instruct2026.06 | 73.9 | 52.1 | |
| PPO (with critic)Type=RL Training, Backbone=Qwen2.5-1.5B-Instruct2026.06 | 73.8 | 51.5 | |
| ReflexionType=Prompting, Backbone=Qwen2.5-7B-Instruct2026.06 | 58.1 | 28.8 | |
| ReflexionType=Prompting, Backbone=Qwen2.5-1.5B-Instruct2026.06 | 55.8 | 21.9 | |
| ReActType=Prompting, Backbone=Qwen2.5-7B-Instruct2026.06 | 46.2 | 19.5 | |
| Gemini-2.5-ProType=Prompting, Backbone=Off-the-shelf2026.06 | 42.5 | 35.9 | |
| ReActType=Prompting, Backbone=Qwen2.5-1.5B-Instruct2026.06 | 40.1 | 11.3 | |
| DeepSeek-V3.2Type=Prompting, Backbone=Off-the-shelf2026.06 | 31.6 | 18 | |
| Qwen3.5-397BType=Prompting, Backbone=Off-the-shelf2026.06 | 27.6 | 17.2 | |
| Qwen2.5Type=Prompting, Backbone=Qwen2.5-7B-Instruct2026.06 | 26.4 | 7.8 | |
| Qwen2.5Type=Prompting, Backbone=Qwen2.5-1.5B-Instruct2026.06 | 23.1 | 5.2 |