Question Answering on 2Wiki 30K context
73.7AccuracyMemOCR
Evaluation results
| Method | Links | |
|---|---|---|
| MemOCRMemory Budget (Tokens)=10242026.01 | 73.7 | |
| MemOCRMemory Budget (Tokens)=2562026.01 | 72.8 | |
| MemOCRMemory Budget (Tokens)=642026.01 | 66.2 | |
| Qwen2.5-1MMemory Budget (Tokens)=100K2026.01 | 65.6 | |
| MemAgentMemory Budget (Tokens)=10242026.01 | 63.8 | |
| MemAgentMemory Budget (Tokens)=2562026.01 | 62.5 | |
| Qwen2.5Memory Budget (Tokens)=100K2026.01 | 61.1 | |
| MemOCRMemory Budget (Tokens)=162026.01 | 56 | |
| Mem0Memory Budget (Tokens)=10242026.01 | 47.7 | |
| Mem0Memory Budget (Tokens)=2562026.01 | 44.8 | |
| MemAgentMemory Budget (Tokens)=642026.01 | 42.7 | |
| Mem0Memory Budget (Tokens)=642026.01 | 42.2 | |
| Mem-αMemory Budget (Tokens)=10242026.01 | 40.1 | |
| Mem-αMemory Budget (Tokens)=2562026.01 | 32.8 | |
| Mem-αMemory Budget (Tokens)=162026.01 | 32.3 | |
| Mem0Memory Budget (Tokens)=162026.01 | 31.5 | |
| Mem-αMemory Budget (Tokens)=642026.01 | 31.5 | |
| R1-Distill QwenMemory Budget (Tokens)=100K2026.01 | 26.6 | |
| MemAgentMemory Budget (Tokens)=162026.01 | 26.3 |