Adversarial Forgetting Evaluation on FORGETEVAL Adv v0.5.1 (full 385 cases)
100Substring TrapLETHE+LLM
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| LETHE+LLMSystem Identity=LETHE, LLM Integration=DeepSeek-V3, LLM hook=JSON hooks2026.06 | 100 | 79.4872 | 81.5789 | 95 | 100 | 100 | 77.5 | 94.5946 | 102.7027 | 100 | 93.3333 | 91.6883 | 88.4 | 2,300 | — | |
| LangMemSystem Identity=LangMem2026.06 | 97.2222 | 69.2308 | 81.5789 | 95 | 100 | 87.5 | 0 | 5.4054 | 2.7027 | 100 | 70.1449 | 62.8571 | 57.9 | 64,000 | — | |
| LETHE2026.06 | 92 | 82 | 82 | 95 | 100 | 88 | 0 | 5 | 0 | 92 | — | 63.4 | — | — | 63.4 | |
| LETHESystem Identity=LETHE2026.06 | 91.6667 | 82.0513 | 81.5789 | 95 | 100 | 87.5 | 0 | 5.4054 | 0 | 100 | 70.7246 | 63.3766 | 58.4 | 74,000 | — | |
| MEM0System Identity=MEM02026.06 | 88.8889 | 30.7692 | 81.5789 | 95 | 100 | 95 | 0 | 48.6486 | 56.7568 | 100 | 76.2319 | 68.3117 | 63.5 | 514,000 | — | |
| A-MEMLLM Backend=DeepSeek-V3, Deployment platform=SiliconFlow, Evolution Status=disabled2026.06 | 20 | 0 | 31 | 19 | 37 | — | 0 | 38 | 38 | 36 | — | 219 | — | — | 219 | |
| MEMPALACESystem Identity=MEMPALACE, Partial-edit primitive support=no-deletion-primitive reference point2026.06 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 191,000 | — |