Question Answering on Average 30K context
69.8AccuracyMemOCR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MemOCRMemory Budget (Tokens)=10242026.01 | 69.8 | — | |
| MemOCRMemory Budget (Tokens)=2562026.01 | 69.5 | 0.5 | |
| MemAgentMemory Budget (Tokens)=10242026.01 | 66.7 | — | |
| MemAgentMemory Budget (Tokens)=2562026.01 | 65.3 | 2.1 | |
| MemOCRMemory Budget (Tokens)=642026.01 | 64.7 | 7.4 | |
| Qwen2.5-1MMemory Budget (Tokens)=100K2026.01 | 63.3 | — | |
| Mem0Memory Budget (Tokens)=10242026.01 | 58.3 | — | |
| Mem0Memory Budget (Tokens)=2562026.01 | 58 | 0.5 | |
| MemOCRMemory Budget (Tokens)=162026.01 | 55.5 | 20.5 | |
| Mem0Memory Budget (Tokens)=642026.01 | 53.2 | 8.8 | |
| MemAgentMemory Budget (Tokens)=642026.01 | 50.3 | 24.7 | |
| Mem-αMemory Budget (Tokens)=10242026.01 | 46.5 | — | |
| Mem0Memory Budget (Tokens)=162026.01 | 42.9 | 26.4 | |
| Mem-αMemory Budget (Tokens)=2562026.01 | 37 | 20.5 | |
| MemAgentMemory Budget (Tokens)=162026.01 | 32.3 | 51.6 | |
| Mem-αMemory Budget (Tokens)=162026.01 | 27 | 42 | |
| Mem-αMemory Budget (Tokens)=642026.01 | 26.4 | 43.2 | |
| R1-Distill QwenMemory Budget (Tokens)=100K2026.01 | 13.7 | — |