Web Navigation on WebShop (val)
85.3Success RateTSR (Beam Search)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| TSR (Beam Search)Model=Qwen2.5-3B2026.02 | 85.3 | 453 | 5.8 | |
| TSR (Lookahead)Model=Qwen2.5-3B2026.02 | 82.3 | 475 | 6.1 | |
| TSR (Best-of-N)Model=Qwen2.5-3B2026.02 | 77.3 | 504 | 6.5 | |
| Instance FilteringModel=Qwen2.5-3B2026.02 | 70.3 | 519 | 6.8 | |
| EVPOBackbone=Qwen2.5-3B-Instruct2026.04 | 30.3 | — | — | |
| PPOBackbone=Qwen2.5-3B-Instruct, Method Category=Critic-based2026.04 | 25.2 | — | — | |
| StarPO-SBackbone=Qwen2.5-3B-Instruct, Method Category=Critic-based2026.04 | 17.8 | — | — | |
| GRPOBackbone=Qwen2.5-3B-Instruct, Method Category=Critic-free2026.04 | 14.3 | — | — | |
| DAPOBackbone=Qwen2.5-3B-Instruct, Method Category=Critic-free2026.04 | 12.7 | — | — | |
| Base ModelModel=Qwen2.5-3B2026.02 | 3 | 747 | 7.7 | |
| Base LLMBackbone=Qwen2.5-3B-Instruct, Method Category=None2026.04 | 2.5 | — | — |