Preference Evaluation via Multi-Choice Queries on PrefEval Implicit
69.9AccuracyMemCoE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MemCoEBackbone=Qwen2.5-7B-Instruct, Retrieval model=all-MiniLM-L6-v2, Top-K retrieval=102026.05 | 69.9 | 52.02 | |
| MemAgentBackbone=Qwen2.5-7B-Instruct, Retrieval model=all-MiniLM-L6-v2, Top-K retrieval=102026.05 | 63.6 | 45 | |
| Mem-αBackbone=Qwen3-4B, Retrieval model=all-MiniLM-L6-v2, Top-K retrieval=102026.05 | 62.5 | 44.19 | |
| LightMemBackbone=Qwen2.5-7B-Instruct, Retrieval model=all-MiniLM-L6-v2, Top-K retrieval=102026.05 | 54.8 | 41.21 | |
| A-MemBackbone=Qwen2.5-7B-Instruct, Retrieval model=all-MiniLM-L6-v2, Top-K retrieval=102026.05 | 52.8 | 42.64 | |
| Mem0Backbone=Qwen2.5-7B-Instruct, Retrieval model=all-MiniLM-L6-v2, Top-K retrieval=102026.05 | 46.4 | 38.23 | |
| RAGBackbone=Qwen2.5-7B-Instruct, Retrieval model=all-MiniLM-L6-v2, Top-K retrieval=102026.05 | 32.4 | 36.68 | |
| Long ContextBackbone=Qwen2.5-7B-Instruct2026.05 | 30.8 | 26.9 |