Long-context memory evaluation on LoCoMo (test)
39.39SingleHop F1PPRO (Ours)
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| PPRO (Ours)Base Model=Qwen2.5-7B, Training Protocol=training-based2026.05 | 39.39 | 29.81 | 52.5 | 43.76 | 24 | 22.25 | 43.34 | 38.08 | 43.2 | 36.68 | |
| MemAgentBase Model=Qwen2.5-7B, Training Protocol=training-based2026.05 | 34.84 | 25.02 | 21.09 | 14.91 | 23.44 | 21.73 | 46.64 | 43.52 | 37.97 | 33.11 | |
| MEM1Base Model=Qwen2.5-7B, Training Protocol=training-based2026.05 | 15.44 | 14.21 | 14.73 | 12.6 | 20.54 | 19.01 | 21.63 | 16.65 | 19.07 | 15.56 |