# Embodied Task Planning on WorldLines Downstream Embodied (planning set) Source: [Embodied Task Planning on WorldLines Downstream Embodied (planning set)]() Collection index: [llms.txt]() Data updated: 2026-06-18T08:15:00.604Z Evaluation of model performance on Embodied Task Planning using the planning set of the WorldLines Downstream dataset. Metrics include Plan Judge score, State consistency, Precondition validity, and Memory use. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Embodied Task Planning | | Dataset (including any stated split) | WorldLines Downstream Embodied (planning set) | | Metric | Plan Judge Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 5 of 5 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Plan Judge Score](): Higher is better; unit: PERCENT. - [State Consistency](): Higher is better; unit: PERCENT. - [Precondition Validity](): Higher is better; unit: PERCENT. - [Memory Use](): Lower is better; unit: PERCENT. ## Recorded results | Method | Plan Judge Score | Result date | Report paper | | --- | --- | --- | --- | | ObsMem | 68.4 | Not recorded | 6a337b82206542251d7c4fc6 | | A-mem | 54.2 | Not recorded | 6a337b82206542251d7c4fc6 | | Mem0 | 52.6 | Not recorded | 6a337b82206542251d7c4fc6 | | GraphMem | 48.1 | Not recorded | 6a337b82206542251d7c4fc6 | | MemoryOS | 33.7 | Not recorded | 6a337b82206542251d7c4fc6 | ### ObsMem Plan Judge Score: 68.4. Result ID: 6a33a8f8fbc373592c30da0b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### A-mem Plan Judge Score: 54.2. Result ID: 6a33a8f8fbc373592c30da07. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Mem0 Plan Judge Score: 52.6. Result ID: 6a33a8f8fbc373592c30da08. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### GraphMem Plan Judge Score: 48.1. Result ID: 6a33a8f8fbc373592c30da09. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### MemoryOS Plan Judge Score: 33.7. Result ID: 6a33a8f8fbc373592c30da0a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.