Question Answering on TriviaQA 10K context
80.8AccuracyMemOCR
Evaluation results
| Method | Links | |
|---|---|---|
| MemOCRMemory Budget (Tokens)=162026.01 | 80.8 | |
| MemOCRMemory Budget (Tokens)=2562026.01 | 79.7 | |
| MemOCRMemory Budget (Tokens)=10242026.01 | 79.6 | |
| MemOCRMemory Budget (Tokens)=642026.01 | 77.6 | |
| Qwen2.5Memory Budget (Tokens)=100K2026.01 | 71.1 | |
| Qwen2.5-1MMemory Budget (Tokens)=100K2026.01 | 71.1 | |
| MemAgentMemory Budget (Tokens)=10242026.01 | 70.1 | |
| Mem0Memory Budget (Tokens)=10242026.01 | 69.5 | |
| Mem0Memory Budget (Tokens)=2562026.01 | 69.5 | |
| MemAgentMemory Budget (Tokens)=2562026.01 | 69.5 | |
| Mem0Memory Budget (Tokens)=642026.01 | 66.4 | |
| Mem0Memory Budget (Tokens)=162026.01 | 65.3 | |
| MemAgentMemory Budget (Tokens)=642026.01 | 64.6 | |
| R1-Distill QwenMemory Budget (Tokens)=100K2026.01 | 54.7 | |
| MemAgentMemory Budget (Tokens)=162026.01 | 49.7 | |
| Mem-αMemory Budget (Tokens)=10242026.01 | 21.1 | |
| Mem-αMemory Budget (Tokens)=2562026.01 | 17.2 | |
| Mem-αMemory Budget (Tokens)=642026.01 | 13 | |
| Mem-αMemory Budget (Tokens)=162026.01 | 11.7 |