Personalized Retrieval and QA on PersonaBench (Noise 0.7)
25.09F1 ScoreMemCoE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MemCoEBackbone=Qwen2.5-7B-Instruct, Retrieval model=all-MiniLM-L6-v2, Top-K retrieval=102026.05 | 25.09 | 52.02 | |
| A-MemBackbone=Qwen2.5-7B-Instruct, Retrieval model=all-MiniLM-L6-v2, Top-K retrieval=102026.05 | 24.45 | 42.64 | |
| RAGBackbone=Qwen2.5-7B-Instruct, Retrieval model=all-MiniLM-L6-v2, Top-K retrieval=102026.05 | 23 | 36.68 | |
| MemAgentBackbone=Qwen2.5-7B-Instruct, Retrieval model=all-MiniLM-L6-v2, Top-K retrieval=102026.05 | 17.92 | 45 | |
| Mem0Backbone=Qwen2.5-7B-Instruct, Retrieval model=all-MiniLM-L6-v2, Top-K retrieval=102026.05 | 17.8 | 38.23 | |
| LightMemBackbone=Qwen2.5-7B-Instruct, Retrieval model=all-MiniLM-L6-v2, Top-K retrieval=102026.05 | 17.8 | 41.21 | |
| Mem-αBackbone=Qwen3-4B, Retrieval model=all-MiniLM-L6-v2, Top-K retrieval=102026.05 | 15.59 | 44.19 | |
| Long ContextBackbone=Qwen2.5-7B-Instruct2026.05 | 13 | 26.9 |