Web Navigation on WebShop (test)
91.37Score3SPO
Evaluation results
| Method | Links | ||
|---|---|---|---|
| 3SPOModel=Qwen2.5-1.5B-Instruct, Type=RL Training2026.06 | 91.37 | 79.46 | |
| 3SPOModel=Qwen2.5-7B-Instruct, Type=RL Training2026.06 | 90.28 | 80.45 | |
| MAGETeacher=Sonnet, n=52026.05 | 90.2 | 84 | |
| MAGETeacher=Opus, n=52026.05 | 89.7 | 82 | |
| HGPOModel=Qwen2.5-7B-Instruct, Type=RL Training2026.06 | 88.96 | 78.51 | |
| GiGPOModel=Qwen2.5-7B-Instruct, Type=RL Training2026.06 | 88.93 | 77.6 | |
| RetroAgentmode=RL-trained reflection2026.05 | 88.9 | 82.3 | |
| RetroAgentmode=in-context, reference=Qwen-7B2026.05 | 87.6 | 78.9 | |
| HGPOModel=Qwen2.5-1.5B-Instruct, Type=RL Training2026.06 | 85.56 | 71.54 | |
| GiGPOModel=Qwen2.5-1.5B-Instruct, Type=RL Training2026.06 | 84.95 | 66.53 | |
| PPO (with critic)Model=Qwen2.5-7B-Instruct, Type=RL Training2026.06 | 81.4 | 68.7 | |
| RLOOModel=Qwen2.5-7B-Instruct, Type=RL Training2026.06 | 80.3 | 65.7 | |
| GRPOModel=Qwen2.5-7B-Instruct, Type=RL Training2026.06 | 79.3 | 66.1 | |
| GRPOModel=Qwen2.5-1.5B-Instruct, Type=RL Training2026.06 | 75.8 | 56.8 | |
| RLOOModel=Qwen2.5-1.5B-Instruct, Type=RL Training2026.06 | 73.9 | 52.1 | |
| PPO (with critic)Model=Qwen2.5-1.5B-Instruct, Type=RL Training2026.06 | 73.8 | 51.5 | |
| ReflexionModel=Qwen2.5-7B-Instruct, Type=Prompting2026.06 | 58.1 | 28.8 | |
| ReflexionModel=Qwen2.5-1.5B-Instruct, Type=Prompting2026.06 | 55.8 | 21.9 | |
| ReActModel=Qwen2.5-7B-Instruct, Type=Prompting2026.06 | 46.2 | 19.5 | |
| Gemini-2.5-ProModel=Closed, Type=Prompting2026.06 | 42.5 | 35.9 | |
| ReActModel=Qwen2.5-1.5B-Instruct, Type=Prompting2026.06 | 40.1 | 11.3 | |
| GPT-4oModel=Closed, Type=Prompting2026.06 | 31.8 | 23.7 | |
| Qwen2.5Model=Qwen2.5-7B-Instruct, Type=Prompting2026.06 | 26.4 | 7.8 | |
| Qwen2.5Model=Qwen2.5-1.5B-Instruct, Type=Prompting2026.06 | 23.1 | 5.2 | |
| SELAURBase Model=Qwen2.5-7B2026.02 | 0.8935 | 79.68 | |
| GiGPOBase Model=Qwen2.5-7B2026.02 | 0.8867 | 79.29 | |
| SELAURBase Model=Qwen2.5-1.5B2026.02 | 0.8812 | 76.56 | |
| RLOOBase Model=Qwen2.5-7B2026.02 | 0.8768 | 75.78 | |
| PPOBase Model=Qwen2.5-7B2026.02 | 0.8689 | 71.87 | |
| GRPOBase Model=Qwen2.5-1.5B2026.02 | 0.8359 | 67.18 | |
| GRPOBase Model=Qwen2.5-7B2026.02 | 0.8184 | 75.78 | |
| RLOOBase Model=Qwen2.5-1.5B2026.02 | 0.8022 | 63.94 | |
| GiGPOBase Model=Qwen2.5-1.5B2026.02 | 0.8017 | 67.57 | |
| PPOBase Model=Qwen2.5-1.5B2026.02 | 0.7126 | 49.21 | |
| promptingBase Model=Qwen2.5-1.5B2026.02 | 0.218 | 4.29 | |
| promptingBase Model=Qwen2.5-7B2026.02 | 0.0288 | 0.39 |