Web-based Shopping on Webshop
73.4P@1GiGPO
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GiGPOTraining Strategy=Training with RL, Base Model=Qwen3-4B2025.12 | 73.4 | 74.6 | 75.2 | |
| GRPOTraining Strategy=Training with RL, Base Model=Qwen3-4B2025.12 | 72.9 | 73 | 73 | |
| LAMERTraining Strategy=Training with Meta-RL, Base Model=Qwen3-4B2025.12 | 67.8 | 84.4 | 89.1 | |
| RLOOTraining Strategy=Training with RL, Base Model=Qwen3-4B2025.12 | 67.6 | 68.4 | 69.1 | |
| PPOTraining Strategy=Training with RL, Base Model=Qwen3-4B2025.12 | 53.1 | 54.5 | 54.9 | |
| ReActTraining Strategy=Prompting, Base Model=Qwen3-4B2025.12 | 3.1 | 4.5 | 4.5 | |
| ReflexionTraining Strategy=Prompting, Base Model=Qwen3-4B2025.12 | 2.7 | 3.3 | 3.5 | |
| Zero-shotTraining Strategy=Prompting, Base Model=Qwen3-4B2025.12 | 1.4 | 2.1 | 2.3 |