Personalized Dialogue Response Generation on PersonaMem 1.0
76.06Overall ScorePersonaTree-ALL
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| PersonaTree-ALLResponse Model=DeepSeek-R1-0528, Memory Model=Qwen3-8B-RL2026.01 | 76.06 | 80.62 | 81.82 | 29.03 | 92.93 | 84.17 | 87.72 | 76.47 | |
| PersonaTree-ALLResponse Model=Longcat-Flash-Chat, Memory Model=Qwen3-8B-RL2026.01 | 75.38 | 93.02 | 70.91 | 30.11 | 93.94 | 71.94 | 85.96 | 88.24 | |
| PersonaTree-ALLResponse Model=DeepSeek-R1-0528, Memory Model=DeepSeek-R1-05282026.01 | 74.87 | 80.62 | 69.09 | 27.96 | 94.95 | 82.01 | 89.47 | 82.35 | |
| PersonaTree-ALLResponse Model=DeepSeek-R1-0528, Memory Model=Qwen2.5-7B-RL2026.01 | 74.7 | 79.84 | 80 | 27.96 | 94.95 | 82.01 | 84.21 | 64.71 | |
| PersonaTree (Router)Response Model=DeepSeek-R1-0528, Memory Model=Qwen3-8B-RL, Route=PersonaTree+Router2026.01 | 74.19 | 80.62 | 67.27 | 25.81 | 95.96 | 83.45 | 84.21 | 76.47 | |
| PersonaTree-ALLResponse Model=Longcat-Flash-Chat, Memory Model=Qwen2.5-7B-RL2026.01 | 73.34 | 93.02 | 67.27 | 27.96 | 92.93 | 67.63 | 89.47 | 70.59 | |
| PersonaTree-ALLResponse Model=Longcat-Flash-Chat, Memory Model=DeepSeek-R1-05282026.01 | 72.67 | 88.37 | 72.73 | 26.88 | 92.93 | 69.78 | 85.96 | 64.71 | |
| PersonaTree (Router)Response Model=Longcat-Flash-Chat, Memory Model=Qwen3-8B-RL, Route=PersonaTree+Router2026.01 | 71.82 | 89.92 | 70.91 | 22.58 | 90.91 | 68.35 | 84.21 | 82.35 | |
| PersonaTree-ALLResponse Model=DeepSeek-V3.1, Memory Model=Qwen2.5-7B-RL2026.01 | 71.31 | 89.15 | 61.82 | 23.66 | 91.92 | 69.06 | 85.96 | 76.47 | |
| PersonaTree-ALLResponse Model=DeepSeek-V3.1, Memory Model=DeepSeek-R1-05282026.01 | 71.14 | 88.37 | 56.36 | 22.58 | 88.89 | 71.22 | 89.47 | 88.24 | |
| PersonaTree-ALLResponse Model=DeepSeek-V3.1, Memory Model=Qwen3-8B-RL2026.01 | 70.8 | 84.5 | 61.82 | 21.51 | 87.88 | 72.66 | 85.96 | 100 | |
| PersonaTree (Router)Response Model=DeepSeek-V3.1, Memory Model=Qwen3-8B-RL, Route=PersonaTree+Router2026.01 | 70.12 | 82.17 | 63.64 | 19.35 | 88.89 | 73.38 | 84.21 | 94.12 | |
| PersonaTree (Fast)Response Model=DeepSeek-R1-0528, Memory Model=Qwen3-8B-RL, Route=PersonaTree (Fast Mode Only)2026.01 | 65.7 | 71.32 | 65.45 | 18.28 | 91.92 | 69.78 | 75.44 | 64.71 | |
| PersonaTree (Fast)Response Model=Longcat-Flash-Chat, Memory Model=Qwen3-8B-RL, Route=PersonaTree (Fast Mode Only)2026.01 | 65.2 | 79.84 | 67.27 | 10.75 | 87.88 | 68.35 | 68.42 | 76.47 | |
| MemoryOSResponse Model=Longcat-Flash-Chat, Memory Model=DeepSeek-R1-05282026.01 | 65.03 | 77.52 | 72.73 | 11.83 | 86.87 | 66.91 | 70.18 | 76.47 | |
| ALL DialogueResponse Model=DeepSeek-R1-05282026.01 | 64.86 | 69.77 | 63.64 | 11.83 | 84.85 | 73.38 | 84.21 | 70.59 | |
| ALL DialogueResponse Model=DeepSeek-V3.12026.01 | 63.84 | 78.29 | 61.82 | 12.9 | 81.82 | 65.47 | 77.19 | 76.47 | |
| MemoryOSResponse Model=DeepSeek-R1-0528, Memory Model=DeepSeek-R1-05282026.01 | 62.65 | 62.79 | 78.18 | 11.83 | 77.78 | 70.5 | 78.95 | 82.35 | |
| MemoryOSResponse Model=DeepSeek-V3.1, Memory Model=DeepSeek-R1-05282026.01 | 62.48 | 72.87 | 65.45 | 11.83 | 84.85 | 63.31 | 73.68 | 76.47 | |
| PersonaTree (Fast)Response Model=DeepSeek-V3.1, Memory Model=Qwen3-8B-RL, Route=PersonaTree (Fast Mode Only)2026.01 | 61.97 | 75.19 | 60 | 4.3 | 83.84 | 64.75 | 75.44 | 88.24 | |
| ALL DialogueResponse Model=Longcat-Flash-Chat2026.01 | 61.8 | 79.07 | 63.64 | 15.05 | 87.88 | 53.96 | 68.42 | 70.59 | |
| A-MemResponse Model=Longcat-Flash-Chat, Memory Model=DeepSeek-R1-05282026.01 | 60.95 | 82.17 | 54.55 | 8.6 | 85.86 | 62.59 | 56.14 | 64.71 | |
| Mem0Response Model=DeepSeek-V3.1, Memory Model=DeepSeek-R1-05282026.01 | 60.44 | 79.84 | 52.73 | 5.38 | 83.84 | 61.15 | 64.91 | 82.35 | |
| A-MemResponse Model=DeepSeek-V3.1, Memory Model=DeepSeek-R1-05282026.01 | 59.76 | 79.84 | 54.55 | 4.3 | 86.87 | 56.83 | 64.91 | 76.47 | |
| Mem0Response Model=Longcat-Flash-Chat, Memory Model=DeepSeek-R1-05282026.01 | 59.59 | 80.62 | 52.73 | 5.38 | 85.86 | 62.59 | 49.12 | 76.47 | |
| LangMemResponse Model=Longcat-Flash-Chat, Memory Model=DeepSeek-R1-05282026.01 | 58.23 | 75.97 | 47.27 | 8.6 | 82.83 | 64.03 | 50.88 | 64.71 | |
| LangMemResponse Model=DeepSeek-V3.1, Memory Model=DeepSeek-R1-05282026.01 | 57.05 | 70.54 | 43.64 | 11.83 | 80.81 | 58.99 | 63.16 | 70.59 | |
| LangMemResponse Model=DeepSeek-R1-0528, Memory Model=DeepSeek-R1-05282026.01 | 54.84 | 63.57 | 61.82 | 15.05 | 78.79 | 56.83 | 50.88 | 41.18 | |
| Only LLMResponse Model=Longcat-Flash-Chat2026.01 | 54.33 | 62.02 | 43.64 | 8.6 | 84.85 | 71.22 | 28.07 | 52.94 | |
| Only LLMResponse Model=DeepSeek-V3.12026.01 | 52.63 | 59.69 | 43.64 | 5.38 | 80.81 | 65.47 | 42.11 | 52.94 | |
| Mem0Response Model=DeepSeek-R1-0528, Memory Model=DeepSeek-R1-05282026.01 | 49.41 | 32.56 | 56.36 | 24.73 | 81.82 | 56.83 | 43.86 | 58.82 | |
| A-MemResponse Model=DeepSeek-R1-0528, Memory Model=DeepSeek-R1-05282026.01 | 47.37 | 30.23 | 45.45 | 22.58 | 77.78 | 59.71 | 36.84 | 76.47 | |
| Only LLMResponse Model=DeepSeek-R1-05282026.01 | 44.14 | 30.23 | 38.18 | 19.35 | 76.77 | 55.4 | 38.6 | 41.18 |