Question Answering on NQ 30K context
51.1AccuracyMem0
Evaluation results
| Method | Links | |
|---|---|---|
| Mem0Memory Budget (Tokens)=2562026.01 | 51.1 | |
| MemOCRMemory Budget (Tokens)=10242026.01 | 49.2 | |
| Mem0Memory Budget (Tokens)=10242026.01 | 48.8 | |
| MemOCRMemory Budget (Tokens)=2562026.01 | 48.8 | |
| MemAgentMemory Budget (Tokens)=10242026.01 | 46.1 | |
| Mem-αMemory Budget (Tokens)=10242026.01 | 44.8 | |
| MemAgentMemory Budget (Tokens)=2562026.01 | 44.3 | |
| Qwen2.5-1MMemory Budget (Tokens)=100K2026.01 | 43.8 | |
| Mem0Memory Budget (Tokens)=642026.01 | 43.8 | |
| MemOCRMemory Budget (Tokens)=642026.01 | 43.6 | |
| MemAgentMemory Budget (Tokens)=642026.01 | 36.5 | |
| MemOCRMemory Budget (Tokens)=162026.01 | 35.9 | |
| Mem0Memory Budget (Tokens)=162026.01 | 34.1 | |
| Mem-αMemory Budget (Tokens)=2562026.01 | 33.6 | |
| Mem-αMemory Budget (Tokens)=162026.01 | 26.3 | |
| Mem-αMemory Budget (Tokens)=642026.01 | 25 | |
| MemAgentMemory Budget (Tokens)=162026.01 | 20.1 | |
| R1-Distill QwenMemory Budget (Tokens)=100K2026.01 | 3.9 |