Question Answering on Average 100K context
67.1AccuracyMemOCR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MemOCRMemory Budget (Tokens)=2562026.01 | 67.1 | 0.8 | |
| MemOCRMemory Budget (Tokens)=10242026.01 | 66.6 | — | |
| MemAgentMemory Budget (Tokens)=10242026.01 | 65.7 | — | |
| MemAgentMemory Budget (Tokens)=2562026.01 | 63.9 | 2.8 | |
| MemOCRMemory Budget (Tokens)=642026.01 | 60.7 | 8.8 | |
| Qwen2.5-1MMemory Budget (Tokens)=100K2026.01 | 58.4 | — | |
| Mem0Memory Budget (Tokens)=2562026.01 | 55 | 2.5 | |
| Mem0Memory Budget (Tokens)=10242026.01 | 53.6 | — | |
| Mem0Memory Budget (Tokens)=642026.01 | 53 | 1.2 | |
| MemOCRMemory Budget (Tokens)=162026.01 | 52.8 | 20.7 | |
| MemAgentMemory Budget (Tokens)=642026.01 | 48.7 | 25.9 | |
| Mem-αMemory Budget (Tokens)=10242026.01 | 47.9 | — | |
| Mem0Memory Budget (Tokens)=162026.01 | 41.1 | 23.4 | |
| Mem-αMemory Budget (Tokens)=2562026.01 | 38.7 | 19.2 | |
| MemAgentMemory Budget (Tokens)=162026.01 | 27.2 | 58.6 | |
| Mem-αMemory Budget (Tokens)=642026.01 | 26.4 | 44.9 | |
| Mem-αMemory Budget (Tokens)=162026.01 | 26.2 | 45.3 | |
| R1-Distill QwenMemory Budget (Tokens)=100K2026.01 | 1.4 | — |