# E-commerce Navigation and Search on WebShop semantic shift Source Source: [E-commerce Navigation and Search on WebShop semantic shift Source]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:03:49.608Z Evaluation of agent performance on E-commerce Navigation and Search tasks using the WebShop semantic shift Source dataset, measured by Score. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | E-commerce Navigation and Search | | Dataset (including any stated split) | WebShop semantic shift Source | | Metric | Score | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Score](): Higher is better; unit: SCALAR. ## Recorded results | Method | Score | Result date | Report paper | | --- | --- | --- | --- | | Vanilla + GLOVE | 1 | Not recorded | 69799808a2b28e761d87cb79 | | MemoryBank + GLOVE | 1 | Not recorded | 69799808a2b28e761d87cb79 | | Voyager + GLOVE | 1 | Not recorded | 69799808a2b28e761d87cb79 | | Generative Agent | 1 | Not recorded | 69799808a2b28e761d87cb79 | | Generative Agent + GLOVE | 1 | Not recorded | 69799808a2b28e761d87cb79 | | MemoryBank | 0.988 | Not recorded | 69799808a2b28e761d87cb79 | | Voyager | 0.962 | Not recorded | 69799808a2b28e761d87cb79 | | No Memory (Plain) | 0.912 | Not recorded | 69799808a2b28e761d87cb79 | | Vanilla | 0.862 | Not recorded | 69799808a2b28e761d87cb79 | | No Memory (Plain) | 0.75 | Not recorded | 69799808a2b28e761d87cb79 | | Vanilla | 0.75 | Not recorded | 69799808a2b28e761d87cb79 | | Vanilla + GLOVE | 0.75 | Not recorded | 69799808a2b28e761d87cb79 | | MemoryBank | 0.75 | Not recorded | 69799808a2b28e761d87cb79 | | MemoryBank + GLOVE | 0.75 | Not recorded | 69799808a2b28e761d87cb79 | | Voyager | 0.75 | Not recorded | 69799808a2b28e761d87cb79 | | Voyager + GLOVE | 0.75 | Not recorded | 69799808a2b28e761d87cb79 | | Generative Agent | 0.75 | Not recorded | 69799808a2b28e761d87cb79 | | Generative Agent + GLOVE | 0.75 | Not recorded | 69799808a2b28e761d87cb79 | ### Vanilla + GLOVE Score: 1. Result ID: 699620905698665ec460e7ca. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Llama3.3-70B","Drift Type":"Implicit","Stage":"Source"}. This record does not assert independent reproduction. ### MemoryBank + GLOVE Score: 1. Result ID: 699620905698665ec460e7cc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Llama3.3-70B","Drift Type":"Implicit","Stage":"Source"}. This record does not assert independent reproduction. ### Voyager + GLOVE Score: 1. Result ID: 699620905698665ec460e7ce. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Llama3.3-70B","Drift Type":"Implicit","Stage":"Source"}. This record does not assert independent reproduction. ### Generative Agent Score: 1. Result ID: 699620905698665ec460e7cf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Llama3.3-70B","Drift Type":"Implicit","Stage":"Source"}. This record does not assert independent reproduction. ### Generative Agent + GLOVE Score: 1. Result ID: 699620905698665ec460e7d0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Llama3.3-70B","Drift Type":"Implicit","Stage":"Source"}. This record does not assert independent reproduction. ### MemoryBank Score: 0.988. Result ID: 699620905698665ec460e7cb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Llama3.3-70B","Drift Type":"Implicit","Stage":"Source"}. This record does not assert independent reproduction. ### Voyager Score: 0.962. Result ID: 699620905698665ec460e7cd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Llama3.3-70B","Drift Type":"Implicit","Stage":"Source"}. This record does not assert independent reproduction. ### No Memory (Plain) Score: 0.912. Result ID: 699620905698665ec460e7c8. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Llama3.3-70B","Drift Type":"Implicit","Stage":"Source"}. This record does not assert independent reproduction. ### Vanilla Score: 0.862. Result ID: 699620905698665ec460e7c9. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Llama3.3-70B","Drift Type":"Implicit","Stage":"Source"}. This record does not assert independent reproduction. ### No Memory (Plain) Score: 0.75. Result ID: 699620905698665ec460ea06. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-30B","Agent Architecture":"No Memory","GLOVE Augmentation":false}. This record does not assert independent reproduction. ### Vanilla Score: 0.75. Result ID: 699620905698665ec460ea07. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-30B","Agent Architecture":"Vanilla","GLOVE Augmentation":false}. This record does not assert independent reproduction. ### Vanilla + GLOVE Score: 0.75. Result ID: 699620905698665ec460ea08. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-30B","Agent Architecture":"Vanilla","GLOVE Augmentation":true}. This record does not assert independent reproduction. ### MemoryBank Score: 0.75. Result ID: 699620905698665ec460ea09. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-30B","Agent Architecture":"MemoryBank","GLOVE Augmentation":false}. This record does not assert independent reproduction. ### MemoryBank + GLOVE Score: 0.75. Result ID: 699620905698665ec460ea0a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-30B","Agent Architecture":"MemoryBank","GLOVE Augmentation":true}. This record does not assert independent reproduction. ### Voyager Score: 0.75. Result ID: 699620905698665ec460ea0b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-30B","Agent Architecture":"Voyager","GLOVE Augmentation":false}. This record does not assert independent reproduction. ### Voyager + GLOVE Score: 0.75. Result ID: 699620905698665ec460ea0c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-30B","Agent Architecture":"Voyager","GLOVE Augmentation":true}. This record does not assert independent reproduction. ### Generative Agent Score: 0.75. Result ID: 699620905698665ec460ea0d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-30B","Agent Architecture":"Generative Agent","GLOVE Augmentation":false}. This record does not assert independent reproduction. ### Generative Agent + GLOVE Score: 0.75. Result ID: 699620905698665ec460ea0e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-30B","Agent Architecture":"Generative Agent","GLOVE Augmentation":true}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.