Web Navigation and Shopping on WebShop (seen)
42.5Success RateSKILLPYRAMID
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SKILLPYRAMIDModel=GPT-4.12026.06 | 42.5 | 15.3 | |
| ReAct + SkillsModel=GPT-4.12026.06 | 38.5 | 22.1 | |
| ReflexionModel=Gemini 2.5 Pro2026.06 | 38.2 | 19.9 | |
| SKILLPYRAMIDModel=Qwen3-235B2026.06 | 38 | 18.4 | |
| ReflexionModel=DeepSeek-V3.22026.06 | 35.3 | 22.4 | |
| SKILLPYRAMIDModel=Gemini 2.5 Pro2026.06 | 35 | 18.2 | |
| ReflexionModel=GPT-4.12026.06 | 34.6 | 20.1 | |
| ExpeLModel=Gemini 2.5 Pro2026.06 | 33.1 | 19.3 | |
| ReAct + SkillsModel=Gemini 2.5 Pro2026.06 | 33 | 18.7 | |
| ExpeLModel=GPT-4.12026.06 | 32.6 | 18.7 | |
| ReflexionModel=Qwen3-235B2026.06 | 32.4 | 20.6 | |
| SKILLPYRAMIDModel=DeepSeek-V3.22026.06 | 32 | 23.9 | |
| ReActModel=Gemini 2.5 Pro2026.06 | 31.7 | 22.1 | |
| ReActModel=DeepSeek-V3.22026.06 | 31.6 | 24.1 | |
| ReAct + SkillsModel=Qwen3-235B2026.06 | 31 | 22.2 | |
| ExpeLModel=Qwen3-235B2026.06 | 30.8 | 19.2 | |
| ReActModel=GPT-4.12026.06 | 30.4 | 21.8 | |
| ExpeLModel=DeepSeek-V3.22026.06 | 29.2 | 24 | |
| ReActModel=Qwen3-235B2026.06 | 28.6 | 22.4 | |
| ReAct + SkillsModel=DeepSeek-V3.22026.06 | 27 | 25.1 |