Question Answering on Average 10K context
74.6AccuracyMemOCR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MemOCRMemory Budget (Tokens)=10242026.01 | 74.6 | — | |
| MemOCRMemory Budget (Tokens)=2562026.01 | 72.6 | 2.7 | |
| MemAgentMemory Budget (Tokens)=10242026.01 | 67.8 | — | |
| MemAgentMemory Budget (Tokens)=2562026.01 | 67.3 | 0.7 | |
| MemOCRMemory Budget (Tokens)=642026.01 | 67.3 | 9.8 | |
| Qwen2.5-1MMemory Budget (Tokens)=100K2026.01 | 66.6 | — | |
| MemOCRMemory Budget (Tokens)=162026.01 | 62.2 | 16.6 | |
| Mem0Memory Budget (Tokens)=10242026.01 | 62 | — | |
| Qwen2.5Memory Budget (Tokens)=100K2026.01 | 61.5 | — | |
| Mem0Memory Budget (Tokens)=2562026.01 | 61.3 | 1.1 | |
| Mem0Memory Budget (Tokens)=642026.01 | 56 | 9.7 | |
| MemAgentMemory Budget (Tokens)=642026.01 | 50.7 | 25.3 | |
| R1-Distill QwenMemory Budget (Tokens)=100K2026.01 | 47.9 | — | |
| Mem-αMemory Budget (Tokens)=10242026.01 | 47.3 | — | |
| Mem0Memory Budget (Tokens)=162026.01 | 43 | 30.6 | |
| Mem-αMemory Budget (Tokens)=2562026.01 | 40.3 | 14.9 | |
| MemAgentMemory Budget (Tokens)=162026.01 | 31.6 | 53.3 | |
| Mem-αMemory Budget (Tokens)=642026.01 | 25.2 | 46.8 | |
| Mem-αMemory Budget (Tokens)=162026.01 | 23.7 | 50 |