# STALE: Can LLM Agents Know When Their Memories Are No Longer Valid?

Source: [STALE: Can LLM Agents Know When Their Memories Are No Longer Valid?](<https://www.sota2.com/research/paper/69fd6e5e5497b3b670c8975d>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-18T06:00:01.085Z

Authors: Hanxiang Chao, Yihan Bai, Rui Sheng, Tianle Li, Yushi Sun

Published: 2026-05-07T16:31:15.000Z

## Abstract

Large Language Model (LLM) agents are increasingly expected to maintain coherent, long-term personalized memory, yet current benchmarks primarily measure static fact retrieval, overlooking the ability to revise stored beliefs when new evidence emerges. We identify a critical and underexplored failure mode, Implicit Conflict: a later observation invalidates an earlier memory without explicit negation, requiring contextual inference and commonsense reasoning to detect. To rigorously evaluate this capability, we introduce STALE, a benchmark of 400 expert-validated conflict scenarios (1,200 evaluation queries across three probing dimensions) spanning over 100 everyday topics with contexts up to 150K tokens. We propose a three-dimensional probing framework that tests State Resolution (detecting that a prior belief is outdated), Premise Resistance (rejecting queries that falsely presuppose a stale state), and Implicit Policy Adaptation (proactively applying updated states in downstream behavior). A systematic evaluation of frontier LLMs and specialized memory frameworks reveals a pervasive gap between retrieving updated evidence and acting on it, with even the best evaluated model achieving only 55.2% overall accuracy. Models often accept outdated assumptions embedded in a user's query, and they struggle to recognize when a change in one aspect of the user's state should invalidate related memories. To establish an initial baseline for state-aware memory, we further present CUPMem, a prototype that strengthens write-time revision through structured state consolidation and propagation-aware search, suggesting that explicit state adjudication is a promising direction for robust agentic memory.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Implicit-conflict resolution on STALE 1.0 (full)](<https://www.sota2.com/research/sota/implicit-conflict-resolution-on-stale-1-0-full.md>): Implicit-conflict resolution; STALE 1.0 (full); Type I SR Accuracy: 91.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2605.06527>)

[PDF](<https://arxiv.org/pdf/2605.06527.pdf>)
