Question Answering on NQ 100K context (Accuracy)
0.583AccuracyMemOCR
Evaluation Results
| Method | Links | |
|---|---|---|
| MemOCRMemory Budget (Tokens)=2562026.01 | 0.583 | |
| MemAgentMemory Budget (Tokens)=10242026.01 | 0.555 | |
| MemOCRMemory Budget (Tokens)=10242026.01 | 0.554 | |
| MemAgentMemory Budget (Tokens)=2562026.01 | 0.536 | |
| Qwen2.5-1MMemory Budget (Tokens)=100K2026.01 | 0.508 | |
| Mem0Memory Budget (Tokens)=642026.01 | 0.5 | |
| Mem0Memory Budget (Tokens)=2562026.01 | 0.497 | |
| Mem0Memory Budget (Tokens)=10242026.01 | 0.482 | |
| MemAgentMemory Budget (Tokens)=642026.01 | 0.479 | |
| MemOCRMemory Budget (Tokens)=642026.01 | 0.475 | |
| MemOCRMemory Budget (Tokens)=162026.01 | 0.459 | |
| Mem0Memory Budget (Tokens)=162026.01 | 0.43 | |
| Mem-αMemory Budget (Tokens)=10242026.01 | 0.43 | |
| Mem-αMemory Budget (Tokens)=2562026.01 | 0.38 | |
| MemAgentMemory Budget (Tokens)=162026.01 | 0.273 | |
| Mem-αMemory Budget (Tokens)=162026.01 | 0.242 | |
| Mem-αMemory Budget (Tokens)=642026.01 | 0.24 | |
| R1-Distill QwenMemory Budget (Tokens)=100K2026.01 | 0.016 |