Personalization Utility on LoCoMo
44.94F1 ScoreMemOS (with intent-legitimation suppression)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MemOS (with intent-legitimation suppression)agent_framework=MemOS, intervention=intent-legitimation suppression, base_model=GPT-4o-mini2026.01 | 44.94 | 37.55 | |
| MemOSagent_framework=MemOS, intervention=none, base_model=GPT-4o-mini2026.01 | 44.18 | 35.58 | |
| MemUagent_framework=MemU, intervention=none, base_model=GPT-4o-mini2026.01 | 34.71 | 28.16 | |
| MemU (with intent-legitimation suppression)agent_framework=MemU, intervention=intent-legitimation suppression, base_model=GPT-4o-mini2026.01 | 34.05 | 27.5 | |
| Amemagent_framework=Amem, intervention=none, base_model=GPT-4o-mini2026.01 | 29.95 | 24.38 | |
| Amem (with intent-legitimation suppression)agent_framework=Amem, intervention=intent-legitimation suppression, base_model=GPT-4o-mini2026.01 | 24.38 | 15.28 |