Personalization Evaluation on PrefEval 10 injected adversarial turns
7.4Pref Unaware RateMemOS-1031
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MemOS-1031Tokens=7992026.01 | 7.4 | 18.6 | 140 | 70 | 71.9 | |
| Mem0Tokens=902026.01 | 14.8 | 18.4 | 310 | 0 | 63.7 | |
| BMAMTokens=–2026.01 | 18.9 | 6.7 | 10 | 140 | 72.9 | |
| SupermemoryTokens=1352026.01 | 23.9 | 17.2 | 180 | 40 | 56.7 | |
| MemUTokens=1142026.01 | 26.5 | 20.3 | 110 | 20 | 51.8 | |
| Bare LLM (+rag)Tokens=3932026.01 | 26.6 | 27.1 | 390 | 0 | 43.2 | |
| MemobaseTokens=5632026.01 | 37 | 25.8 | 200 | 10 | 34.1 | |
| ZepTokens=9012026.01 | 41 | 15.7 | 210 | 130 | 39.9 | |
| MIRIXTokens=–2026.01 | 77.9 | 72 | 0 | 700 | 7.9 | |
| Bare LLMTokens=11k2026.01 | 93.2 | 3.9 | 10 | 0 | 2.8 |