Web Navigation on WebShop Drift I - Semantic Shift
95Success RateVanilla + GLOVE
Evaluation Results
| Method | Links | |
|---|---|---|
| Vanilla + GLOVELLM Backbone=Llama3.3-70B2026.01 | 95 | |
| MemoryBank + GLOVELLM Backbone=Llama3.3-70B2026.01 | 95 | |
| Voyager + GLOVELLM Backbone=Llama3.3-70B2026.01 | 95 | |
| Generative Agent + GLOVELLM Backbone=Llama3.3-70B2026.01 | 95 | |
| Vanilla + GLOVEBackbone=Qwen3-30B2026.01 | 95 | |
| MemoryBank + GLOVEBackbone=Qwen3-30B2026.01 | 95 | |
| Voyager + GLOVEBackbone=Qwen3-30B2026.01 | 95 | |
| Generative Agent + GLOVEBackbone=Qwen3-30B2026.01 | 95 | |
| No Memory (Plain)LLM Backbone=Llama3.3-70B2026.01 | 50 | |
| MemoryBankLLM Backbone=Llama3.3-70B2026.01 | 35 | |
| MemoryBankBackbone=Qwen3-30B2026.01 | 35 | |
| No Memory (Plain)Backbone=Qwen3-30B2026.01 | 30 | |
| VanillaLLM Backbone=Llama3.3-70B2026.01 | 0 | |
| VoyagerLLM Backbone=Llama3.3-70B2026.01 | 0 | |
| Generative AgentLLM Backbone=Llama3.3-70B2026.01 | 0 | |
| VanillaBackbone=Qwen3-30B2026.01 | 0 | |
| VoyagerBackbone=Qwen3-30B2026.01 | 0 | |
| Generative AgentBackbone=Qwen3-30B2026.01 | 0 |