Question Answering on TriviaQA 100K context
70.2AccuracyMemOCR
Evaluation results
| Method | Links | |
|---|---|---|
| MemOCRMemory Budget (Tokens)=642026.01 | 70.2 | |
| MemOCRMemory Budget (Tokens)=10242026.01 | 69.8 | |
| MemOCRMemory Budget (Tokens)=2562026.01 | 68.9 | |
| MemAgentMemory Budget (Tokens)=2562026.01 | 67.2 | |
| MemOCRMemory Budget (Tokens)=162026.01 | 67.2 | |
| MemAgentMemory Budget (Tokens)=10242026.01 | 66.7 | |
| Mem0Memory Budget (Tokens)=2562026.01 | 62.8 | |
| Mem0Memory Budget (Tokens)=642026.01 | 62.5 | |
| Mem0Memory Budget (Tokens)=10242026.01 | 61.4 | |
| MemAgentMemory Budget (Tokens)=642026.01 | 59.6 | |
| Qwen2.5-1MMemory Budget (Tokens)=100K2026.01 | 59.4 | |
| Mem0Memory Budget (Tokens)=162026.01 | 58.9 | |
| MemAgentMemory Budget (Tokens)=162026.01 | 41.7 | |
| Mem-αMemory Budget (Tokens)=10242026.01 | 19.3 | |
| Mem-αMemory Budget (Tokens)=2562026.01 | 18.3 | |
| Mem-αMemory Budget (Tokens)=162026.01 | 14.3 | |
| Mem-αMemory Budget (Tokens)=642026.01 | 13.8 | |
| R1-Distill QwenMemory Budget (Tokens)=100K2026.01 | 0.8 |