# Dialogue Question Answering on LoCoMo 10 conversations (full release) Source: [Dialogue Question Answering on LoCoMo 10 conversations (full release)]() Collection index: [llms.txt]() Data updated: 2026-05-15T06:46:15.520Z Evaluation of Dialogue Question Answering performance on the full release of the LoCoMo 10 conversations dataset, reporting F1 and BLEU scores across Multi-Hop, Single-Hop, Temporal, Open-Domain, Adversarial, and Overall question types. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Dialogue Question Answering | | Dataset (including any stated split) | LoCoMo 10 conversations (full release) | | Metric | MultiHop F1 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 14 of 14 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [MultiHop F1](): Higher is better; unit: PERCENT. - [MultiHop BLEU](): Higher is better; unit: PERCENT. - [SingleHop F1](): Higher is better; unit: PERCENT. - [SingleHop BLEU](): Higher is better; unit: PERCENT. - [Temporal F1](): Higher is better; unit: PERCENT. - [Temporal BLEU](): Higher is better; unit: PERCENT. - [OpenDomain F1](): Higher is better; unit: PERCENT. - [OpenDomain BLEU](): Higher is better; unit: PERCENT. - [Adversarial F1](): Higher is better; unit: PERCENT. - [Adversarial BLEU](): Higher is better; unit: PERCENT. - [Overall F1](): Higher is better; unit: PERCENT. - [Overall BLEU](): Higher is better; unit: PERCENT. ## Recorded results | Method | MultiHop F1 | Result date | Report paper | | --- | --- | --- | --- | | EVOLVEMEM | 35.2 | Not recorded | 6a06a867dbc836b87d829eb6 | | SimpleMem | 31.8 | Not recorded | 6a06a867dbc836b87d829eb6 | | EVOLVEMEM | 31.6 | Not recorded | 6a06a867dbc836b87d829eb6 | | Mem0 | 30.9 | Not recorded | 6a06a867dbc836b87d829eb6 | | MemGPT | 30.5 | Not recorded | 6a06a867dbc836b87d829eb6 | | SimpleMem | 30.5 | Not recorded | 6a06a867dbc836b87d829eb6 | | A-MEM | 29.5 | Not recorded | 6a06a867dbc836b87d829eb6 | | Claude-Mem | 29.4 | Not recorded | 6a06a867dbc836b87d829eb6 | | Mem0 | 29.2 | Not recorded | 6a06a867dbc836b87d829eb6 | | Claude-Mem | 28.9 | Not recorded | 6a06a867dbc836b87d829eb6 | | MemGPT | 28.8 | Not recorded | 6a06a867dbc836b87d829eb6 | | MemVerse | 28.7 | Not recorded | 6a06a867dbc836b87d829eb6 | | A-MEM | 28.7 | Not recorded | 6a06a867dbc836b87d829eb6 | | MemVerse | 26 | Not recorded | 6a06a867dbc836b87d829eb6 | ### EVOLVEMEM MultiHop F1: 35.2. Result ID: 6a06bfbb47f34ce924edb677. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GPT-5.1"}. This record does not assert independent reproduction. ### SimpleMem MultiHop F1: 31.8. Result ID: 6a06bfbb47f34ce924edb66f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"GPT-4o"}. This record does not assert independent reproduction. ### EVOLVEMEM MultiHop F1: 31.6. Result ID: 6a06bfbb47f34ce924edb670. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GPT-4o"}. This record does not assert independent reproduction. ### Mem0 MultiHop F1: 30.9. Result ID: 6a06bfbb47f34ce924edb66b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GPT-4o"}. This record does not assert independent reproduction. ### MemGPT MultiHop F1: 30.5. Result ID: 6a06bfbb47f34ce924edb66e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GPT-4o"}. This record does not assert independent reproduction. ### SimpleMem MultiHop F1: 30.5. Result ID: 6a06bfbb47f34ce924edb676. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"GPT-5.1"}. This record does not assert independent reproduction. ### A-MEM MultiHop F1: 29.5. Result ID: 6a06bfbb47f34ce924edb66d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GPT-4o"}. This record does not assert independent reproduction. ### Claude-Mem MultiHop F1: 29.4. Result ID: 6a06bfbb47f34ce924edb66c. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"GPT-4o"}. This record does not assert independent reproduction. ### Mem0 MultiHop F1: 29.2. Result ID: 6a06bfbb47f34ce924edb672. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GPT-5.1"}. This record does not assert independent reproduction. ### Claude-Mem MultiHop F1: 28.9. Result ID: 6a06bfbb47f34ce924edb673. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"GPT-5.1"}. This record does not assert independent reproduction. ### MemGPT MultiHop F1: 28.8. Result ID: 6a06bfbb47f34ce924edb675. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GPT-5.1"}. This record does not assert independent reproduction. ### MemVerse MultiHop F1: 28.7. Result ID: 6a06bfbb47f34ce924edb671. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GPT-5.1"}. This record does not assert independent reproduction. ### A-MEM MultiHop F1: 28.7. Result ID: 6a06bfbb47f34ce924edb674. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GPT-5.1"}. This record does not assert independent reproduction. ### MemVerse MultiHop F1: 26. Result ID: 6a06bfbb47f34ce924edb66a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GPT-4o"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.