# Long-Context Memory Retrieval and Reasoning on LongMemEval 50K context input token limit

Source: [Long-Context Memory Retrieval and Reasoning on LongMemEval 50K context input token limit](<https://www.sota2.com/research/sota/long-context-memory-retrieval-and-reasoning-on-longmemeval-50k-context-input-token-limit>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-11T10:26:30.330Z

Evaluation of model performance on the LongMemEval dataset configured with a 50,000 token context limit, assessing long-context memory retrieval and reasoning using specific L-J score metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Long-Context Memory Retrieval and Reasoning |
| Dataset (including any stated split) | LongMemEval 50K context input token limit |
| Metric | KU L-J Score |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [KU L-J Score](<https://www.sota2.com/research/sota/long-context-memory-retrieval-and-reasoning-on-longmemeval-50k-context-input-token-limit.md?metric=KU%20L-J%20Score>): Higher is better; unit: SCALAR.

- [SS-assist L-J Score](<https://www.sota2.com/research/sota/long-context-memory-retrieval-and-reasoning-on-longmemeval-50k-context-input-token-limit.md?metric=SS-assist%20L-J%20Score>): Higher is better; unit: SCALAR.

- [SS-prefer L-J Score](<https://www.sota2.com/research/sota/long-context-memory-retrieval-and-reasoning-on-longmemeval-50k-context-input-token-limit.md?metric=SS-prefer%20L-J%20Score>): Higher is better; unit: SCALAR.

- [SS-user L-J Score](<https://www.sota2.com/research/sota/long-context-memory-retrieval-and-reasoning-on-longmemeval-50k-context-input-token-limit.md?metric=SS-user%20L-J%20Score>): Higher is better; unit: SCALAR.

- [Temporal L-J Score](<https://www.sota2.com/research/sota/long-context-memory-retrieval-and-reasoning-on-longmemeval-50k-context-input-token-limit.md?metric=Temporal%20L-J%20Score>): Higher is better; unit: SCALAR.

- [Overall L-J Score](<https://www.sota2.com/research/sota/long-context-memory-retrieval-and-reasoning-on-longmemeval-50k-context-input-token-limit.md?metric=Overall%20L-J%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | KU L-J Score | Result date | Report paper |
| --- | --- | --- | --- |
| HORMA | 89.7 | Not recorded | 6a2a4136d33dfb23e783943b |
| Acon | 64.1 | Not recorded | 6a2a4136d33dfb23e783943b |
| A-MEM | 64.1 | Not recorded | 6a2a4136d33dfb23e783943b |
| Truncation | 62.8 | Not recorded | 6a2a4136d33dfb23e783943b |
| ReSum | 60.3 | Not recorded | 6a2a4136d33dfb23e783943b |
| Embedding Retrieval | 44.9 | Not recorded | 6a2a4136d33dfb23e783943b |
| Mem0 | 42.3 | Not recorded | 6a2a4136d33dfb23e783943b |
| No limit | 37.2 | Not recorded | 6a2a4136d33dfb23e783943b |
| Embedding | 37.2 | Not recorded | 6a2a4136d33dfb23e783943b |
| Slide Window | 19.2 | Not recorded | 6a2a4136d33dfb23e783943b |

### HORMA

KU L-J Score: 89.7. Result ID: 6a2a8bedfbc373592c28575c.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a4136d33dfb23e783943b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2a4136d33dfb23e783943b.md>)

Recorded evaluation configuration: {"Primary Agent Backbone":"Claude Sonnet 4.5","Memory Architecture Category":"External Dynamic Memory","Context Token Limit":"50K"}. This record does not assert independent reproduction.

### Acon

KU L-J Score: 64.1. Result ID: 6a2a8bedfbc373592c285758.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a4136d33dfb23e783943b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c441e209131cea8d495.md>)

Recorded evaluation configuration: {"Primary Agent Backbone":"Claude Sonnet 4.5","Memory Architecture Category":"Internal Dynamic Memory","Context Token Limit":"50K"}. This record does not assert independent reproduction.

### A-MEM

KU L-J Score: 64.1. Result ID: 6a2a8bedfbc373592c285759.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a4136d33dfb23e783943b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bf31e209131cea8b869.md>)

Recorded evaluation configuration: {"Primary Agent Backbone":"Claude Sonnet 4.5","Memory Architecture Category":"External Dynamic Memory","Context Token Limit":"50K"}. This record does not assert independent reproduction.

### Truncation

KU L-J Score: 62.8. Result ID: 6a2a8bedfbc373592c285754.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a4136d33dfb23e783943b.md>)

Recorded evaluation configuration: {"Primary Agent Backbone":"Claude Sonnet 4.5","Memory Architecture Category":"Internal Static Memory","Context Token Limit":"50K"}. This record does not assert independent reproduction.

### ReSum

KU L-J Score: 60.3. Result ID: 6a2a8bedfbc373592c285757.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a4136d33dfb23e783943b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c1e1e209131cea8c7b5.md>)

Recorded evaluation configuration: {"Primary Agent Backbone":"Claude Sonnet 4.5","Memory Architecture Category":"Internal Dynamic Memory","Context Token Limit":"50K"}. This record does not assert independent reproduction.

### Embedding Retrieval

KU L-J Score: 44.9. Result ID: 6a2a8bedfbc373592c28575b.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a4136d33dfb23e783943b.md>)

Recorded evaluation configuration: {"Primary Agent Backbone":"Claude Sonnet 4.5","Memory Architecture Category":"External Dynamic Memory","Context Token Limit":"50K"}. This record does not assert independent reproduction.

### Mem0

KU L-J Score: 42.3. Result ID: 6a2a8bedfbc373592c28575a.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a4136d33dfb23e783943b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa784b1e209131cea77ad6.md>)

Recorded evaluation configuration: {"Primary Agent Backbone":"Claude Sonnet 4.5","Memory Architecture Category":"External Dynamic Memory","Context Token Limit":"50K"}. This record does not assert independent reproduction.

### No limit

KU L-J Score: 37.2. Result ID: 6a2a8bedfbc373592c285753.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a4136d33dfb23e783943b.md>)

Recorded evaluation configuration: {"Primary Agent Backbone":"Claude Sonnet 4.5","Context Token Limit":"No limit"}. This record does not assert independent reproduction.

### Embedding

KU L-J Score: 37.2. Result ID: 6a2a8bedfbc373592c285756.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a4136d33dfb23e783943b.md>)

Recorded evaluation configuration: {"Primary Agent Backbone":"Claude Sonnet 4.5","Memory Architecture Category":"Internal Static Memory","Context Token Limit":"50K"}. This record does not assert independent reproduction.

### Slide Window

KU L-J Score: 19.2. Result ID: 6a2a8bedfbc373592c285755.

[Reporting paper](<https://www.sota2.com/research/paper/6a2a4136d33dfb23e783943b.md>)

Recorded evaluation configuration: {"Primary Agent Backbone":"Claude Sonnet 4.5","Memory Architecture Category":"Internal Static Memory","Context Token Limit":"50K"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
