Interactive Agent on WebShop (Pass@1, Pass@128)
68.65Pass@1ACE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ACEBackbone=Qwen2.5-7B2026.03 | 68.65 | 86.8 | |
| GRPO-RLVRBackbone=Qwen2.5-7B2026.03 | 67.45 | 85.4 | |
| LEAFEBackbone=Qwen2.5-7B2026.03 | 66.5 | 87.8 | |
| EARLYEXPBackbone=Qwen2.5-7B2026.03 | 61.55 | 84.6 | |
| LEAFEBackbone=Llama3.1-8B2026.03 | 56.25 | 81 | |
| GRPO-RLVRBackbone=Llama3.1-8B2026.03 | 54.95 | 79.4 | |
| ACEBackbone=Llama3.1-8B2026.03 | 54.35 | 79.8 | |
| EARLYEXPBackbone=Llama3.1-8B2026.03 | 51.13 | 77.8 | |
| BASE (NO FT)Backbone=Qwen2.5-7B2026.03 | 0.05 | 5.2 | |
| BASE (NO FT)Backbone=Llama3.1-8B2026.03 | 0 | 1.8 |