Language Agent Task on AgentGym WebShop (test)
97.5Success RateAAWM
Evaluation results
| Method | Links | |
|---|---|---|
| AAWMEvaluation Protocol=Imitation Learning, Training Initialization=World Modeling (AAWM), Trajectory Mixture=AgentTraj-L, Base Model=Qwen2.5-1.5B-Instruct2026.06 | 97.5 | |
| BaseEvaluation Protocol=Imitation Learning, Training Initialization=World Modeling (Base), Trajectory Mixture=AgentTraj-L, Base Model=Qwen2.5-1.5B-Instruct2026.06 | 94.5 | |
| IWM-SummaryEvaluation Protocol=Imitation Learning, Training Initialization=World Modeling (IWM-Summary), Trajectory Mixture=AgentTraj-L, Base Model=Qwen2.5-1.5B-Instruct2026.06 | 94.5 | |
| IWMEvaluation Protocol=Imitation Learning, Training Initialization=World Modeling (IWM), Trajectory Mixture=AgentTraj-L, Base Model=Qwen2.5-1.5B-Instruct2026.06 | 83 | |
| Qwen2.5Evaluation Protocol=Prompting, Base Model=Qwen2.5-1.5B-Instruct2026.06 | 21.3 |