Role-playing quality evaluation on RoleMemo (test)
4.22Information RichnessDUALMEM-RL
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| DUALMEM-RLFramework=DUALMEM Framework2026.05 | 4.22 | 3.78 | 4.37 | 4.27 | 4.16 | |
| DUALMEM-SFTFramework=DUALMEM Framework2026.05 | 4.18 | 3.77 | 4.35 | 4.26 | 4.15 | |
| DUALMEM-RLAblation=w/o Insight2026.05 | 4.12 | 3.57 | 4.19 | 4.16 | 4.01 | |
| DUALMEM-RLAblation=w/o Training2026.05 | 4.12 | 3.62 | 4.12 | 4.19 | 4.02 | |
| SimpleMemCategory=Baseline Agentic Memory Framework2026.05 | 4.1 | 3.53 | 4.15 | 4.13 | 3.97 | |
| Mem0Category=Baseline Agentic Memory Framework2026.05 | 4.1 | 3.55 | 4.18 | 4.15 | 4 | |
| PreMemCategory=Baseline Agentic Memory Framework2026.05 | 4.09 | 3.56 | 4.18 | 4.13 | 3.99 | |
| LightMemCategory=Baseline Agentic Memory Framework2026.05 | 4.07 | 3.55 | 4.19 | 4.13 | 4 | |
| O-MemCategory=Baseline Agentic Memory Framework2026.05 | 4.07 | 3.54 | 4.17 | 4.12 | 3.98 | |
| MirixCategory=Baseline Agentic Memory Framework2026.05 | 4.06 | 3.54 | 4.16 | 4.13 | 4.01 | |
| MemalphaCategory=Baseline Agentic Memory Framework2026.05 | 4.05 | 3.51 | 4.15 | 4.08 | 3.95 | |
| HiMemCategory=Baseline Agentic Memory Framework2026.05 | 4.05 | 3.49 | 4.13 | 4.08 | 3.94 | |
| DUALMEM-RLAblation=w/o Fact2026.05 | 3.98 | 3.64 | 4.25 | 4.15 | 4 | |
| NoMemSetting=Base Setting2026.05 | 3.65 | 3.29 | 4.08 | 4.02 | 3.76 |