Agentic Reasoning on LoCoMo
72.3Org. ScoreCAMEL
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| CAMELMemory System=AriGraph, Backbone=LLAMA-42026.05 | 72.3 | 53.4 | 25.6 | 36.1 | |
| IPWMemory System=AriGraph, Backbone=LLAMA-42026.05 | 69.1 | 56.5 | 29.4 | 50.2 | |
| CAMELMemory System=G-Mem., Backbone=LLAMA-42026.05 | 68 | 46.8 | 20.2 | 37.9 | |
| DeCoTMemory System=AriGraph, Backbone=LLAMA-42026.05 | 62.4 | 60.2 | 32.1 | 47.1 | |
| DeCoTMemory System=G-Mem., Backbone=LLAMA-42026.05 | 60.8 | 59.5 | 32.7 | 49.8 | |
| JTTMemory System=AriGraph, Backbone=LLAMA-42026.05 | 59.4 | 68.7 | 38.3 | 57.8 | |
| VanillaMemory System=AriGraph, Backbone=LLAMA-42026.05 | 58.7 | 72.4 | 44.9 | 61.5 | |
| IPWMemory System=G-Mem., Backbone=LLAMA-42026.05 | 57.5 | 60.1 | 33.8 | 50.4 | |
| CAMELMemory System=A-Mem, Backbone=LLAMA-42026.05 | 53.8 | 29.9 | 10.1 | 28.9 | |
| CAMELMemory System=Mem0, Backbone=LLAMA-42026.05 | 53.3 | 41.4 | 15.5 | 33.7 | |
| JTTMemory System=G-Mem., Backbone=LLAMA-42026.05 | 53.1 | 64.3 | 36.8 | 52.7 | |
| VanillaMemory System=G-Mem., Backbone=LLAMA-42026.05 | 52.4 | 67.8 | 39.5 | 56.3 | |
| DeCoTMemory System=Mem0, Backbone=LLAMA-42026.05 | 49.4 | 57.3 | 31.2 | 45.9 | |
| DeCoTMemory System=A-Mem, Backbone=LLAMA-42026.05 | 46.2 | 43.7 | 23.4 | 37.5 | |
| JTTMemory System=Mem0, Backbone=LLAMA-42026.05 | 45.3 | 60.8 | 29.4 | 48.7 | |
| VanillaMemory System=Mem0, Backbone=LLAMA-42026.05 | 43.7 | 63.4 | 34.8 | 52.1 | |
| IPWMemory System=A-Mem, Backbone=LLAMA-42026.05 | 42.6 | 46.2 | 24.8 | 42.4 | |
| IPWMemory System=Mem0, Backbone=LLAMA-42026.05 | 38.8 | 67.2 | 37.1 | 56.8 | |
| VanillaMemory System=A-Mem, Backbone=LLAMA-42026.05 | 36.2 | 58.9 | 29.4 | 47.3 | |
| JTTMemory System=A-Mem, Backbone=LLAMA-42026.05 | 32.4 | 54.7 | 32.1 | 54.6 |