Memory Construction Quality on RoleMemo 1.0 (test)
80Interpretive Attribution Fact (Recall@10)DUALMEM-RL
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| DUALMEM-RL2026.05 | 80 | 78 | 74 | 71 | 75 | 76 | 79 | 67 | 77 | 73 | |
| DUALMEM-SFT2026.05 | 76 | 69 | 77 | 61 | 74 | 65 | 77 | 65 | 76 | 65 | |
| Mem02026.05 | 74 | 30 | 72 | 36 | 74 | 45 | 76 | 34 | 74 | 36 | |
| LightMem2026.05 | 70 | 31 | 72 | 35 | 68 | 39 | 65 | 29 | 69 | 33 | |
| O-MemFixed hierarchical schema=true2026.05 | 70 | 27 | 66 | 38 | 70 | 35 | 66 | 30 | 68 | 33 | |
| PreMem2026.05 | 69 | 37 | 70 | 35 | 65 | 37 | 70 | 31 | 69 | 35 | |
| SimpleMem2026.05 | 69 | 35 | 70 | 41 | 70 | 48 | 71 | 41 | 70 | 41 | |
| MirixFixed hierarchical schema=true2026.05 | 43 | 12 | 37 | 15 | 43 | 18 | 45 | 13 | 42 | 15 | |
| HiMemFixed hierarchical schema=true2026.05 | 37 | 22 | 35 | 36 | 37 | 27 | 38 | 23 | 37 | 27 | |
| MemalphaFixed hierarchical schema=true2026.05 | 15 | 5 | 23 | 10 | 21 | 10 | 21 | 9 | 20 | 8 |