Question Answering on LOCOMO 1,542 QA (full)
22.7ROUGE-LNaiveRAG
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| NaiveRAGEmbedding Model=gte-Qwen2 (1536-d)2026.06 | 22.7 | 53.6 | 71.5 | 44.8 | 53.1 | 2.36 | 2,570 | |
| CoreMem-FusionEmbedding Model=MiniLM-L6 (384-d)2026.06 | 22.7 | 53.2 | 72.3 | 46.9 | 54 | 2.09 | 2,232 | |
| Mem0Embedding Model=gte-Qwen2 (1536-d)2026.06 | 22.6 | 53.6 | 71.8 | 43.8 | 53.3 | 2.36 | 2,579 | |
| MemoryOSEmbedding Model=gte-Qwen2 (1536-d)2026.06 | 22.3 | 52.9 | 71 | 45.8 | 52.9 | 2.36 | 3,659 | |
| CoreMem-FusionEmbedding Model=gte-Qwen2 (1536-d)2026.06 | 22.2 | 51 | 72.2 | 45.8 | 53.6 | 2.3 | 2,865 | |
| Mem0Embedding Model=MiniLM-L6 (384-d)2026.06 | 21.6 | 51.5 | 67.9 | 40.6 | 50.3 | 2.05 | 2,267 | |
| NaiveRAGEmbedding Model=MiniLM-L6 (384-d)2026.06 | 21.5 | 51.5 | 67.8 | 42.7 | 50.3 | 2.05 | 2,904 | |
| MemoryOSEmbedding Model=MiniLM-L6 (384-d)2026.06 | 21.5 | 51.7 | 67.8 | 41.7 | 50.1 | 2.05 | 2,269 | |
| MemoryBankEmbedding Model=MiniLM-L6 (384-d)2026.06 | 7.9 | 16.4 | 11.3 | 22.9 | 9.7 | 2.47 | 2,263 | |
| MemoryBankEmbedding Model=gte-Qwen2 (1536-d)2026.06 | 7.6 | 14.6 | 11.2 | 25 | 9.9 | 2.34 | 2,904 |