Long-context Retrieval-Augmented Generation on LongMemEval
63.2Temperature ScoreEvoEmbedding-4B
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| EvoEmbedding-4BFramework=NaiveRAG2026.06 | 63.2 | 71.4 | 84.6 | 98.6 | 100 | 60 | 77.6 | |
| KaLM-Embedding-Gemma3-12BFramework=NaiveRAG2026.06 | 60.9 | 58.6 | 80.8 | 92.9 | 98.2 | 73.3 | 72.8 | |
| Qwen3-Embedding-8BFramework=NaiveRAG2026.06 | 57.9 | 62.4 | 76.9 | 90 | 98.2 | 63.3 | 71.4 | |
| LightMemSystem Type=Agentic Memory Systems2026.06 | 54.2 | 51.9 | 66.7 | 80 | 31.3 | 80 | 70.2 | |
| A-MEMSystem Type=Agentic Memory Systems2026.06 | 51.9 | 51.1 | 76.9 | 90 | 96.4 | 40 | 65.2 | |
| Mem0System Type=Agentic Memory Systems2026.06 | 41.9 | 28.1 | 28.6 | 55.3 | 26.1 | 81.8 | 39.5 | |
| all-MiniLM-L6-v2Framework=NaiveRAG2026.06 | 40.6 | 34.6 | 70.5 | 77.1 | 96.4 | 60 | 56.2 | |
| Full Context2026.06 | 33.1 | 35.6 | 76.9 | 82.9 | 87.5 | 50 | 54.8 | |
| MemoryOSSystem Type=Agentic Memory Systems2026.06 | 28.6 | 36.8 | 61.5 | 72.9 | 92.9 | 33.3 | 49.6 |