List your company
ResearchFormerly WizWand

Temporal Question Answering on LoCoMo

0.6634F1ShardMemo
-0.0086480.1658260.34030.514774Jan 29, 2026Feb 17, 2026Mar 8, 2026Mar 28, 2026Apr 16, 2026May 5, 2026May 25, 2026
Updated 4mo ago

Evaluation results

MethodLinks
ShardMemoModel=GPT-OSS-120B2026.010.6634——0.6031——
LightMEMModel=GPT-4o2026.010.6466——0.4658——
LightMEM+AMAModel=GPT-4o2026.010.6372——0.4595——
MEMIRBackbone=GPT-4.1-mini2026.050.635——0.5870.846—
MEMORARetriever Type=Semantic Retriever2026.020.6240.5020.851———
MEMORARetriever Type=Policy Retriever2026.020.6230.50.866———
MEMIRBackbone=GPT-4.12026.050.618——0.5570.863—
Nemori+AMAModel=GPT-4o2026.010.6065——0.5121——
SimpleMemBackbone=GPT-4.1-mini2026.050.604——0.5340.807—
SimpleMemBackbone=GPT-4.12026.050.601——0.5360.819—
GAMModel=GPT-OSS-120B2026.010.5952——0.527——
NEMORIBackbone=GPT-4.12026.050.592——0.5240.796—
Nemori+AMAModel=GPT-4o-mini2026.010.5914——0.5001——
NEMORIBackbone=GPT-4.1-mini2026.050.587——0.5070.773—
NemoriModel=GPT-4o-mini2026.010.5838——0.4862——
Nemori*2026.020.5770.5020.776———
O-MemBackbone=GPT-4.12026.050.5748——0.4976——
Full Context2026.020.5720.5060.819———
LightMEM+AMAModel=GPT-4o-mini2026.010.5597——0.4257——
NemoriModel=GPT-4o2026.010.5586——0.473——
LightMEMModel=GPT-4o-mini2026.010.5468——0.4077——
LangMemBackbone=GPT-4.12026.050.5367——0.4622——
HeLa-MemModel=GPT-4o, Token Length=1,0362026.040.5079——0.4454——
SwiftMemBackbone=GPT-4.1-mini2026.050.507——0.5690.685—
A-MEM+AMAModel=GPT-4o2026.010.4965——0.3861——
A-MEMModel=GPT-4o2026.010.493——0.382——
Mem02026.020.4890.420.66———
RAG2026.020.4860.4280.548———
LangMem*2026.020.4850.4090.508———
LangMemBackbone=GPT-4.1-mini2026.050.485——0.4090.508—
MEM0Model=GPT-OSS-120B2026.010.4764——0.4127——
HeLa-MemModel=GPT-4o-mini, Token Length=1,0102026.040.4729——0.4128——
HIMEMBackbone=GPT-4.12026.050.468——0.3960.805—
A-MEMModel=GPT-OSS-120B2026.010.462——0.3714——
A-MemModel=GPT-4o-mini, Token Length=2,5202026.040.4585——0.3667——
RAGModel=GPT-OSS-120B2026.010.4357——0.3726——
MemoryOSModel=GPT-4o, Token Length=2,0002026.040.4357——0.3355——
Mem0Backbone=GPT-4.12026.050.435——0.3670.607—
HIMEMBackbone=GPT-4.1-mini2026.050.43——0.3880.792—
MEMORYOSModel=GPT-OSS-120B2026.010.424——0.3281——
A-MemBackbone=GPT-4.12026.050.422——0.3360.689—
MemoryOSModel=GPT-4o-mini, Token Length=2,0002026.040.4158——0.3599——
LIGHTMEMModel=GPT-OSS-120B2026.010.4148——0.3682——
A-MemBackbone=GPT-4.1-mini2026.050.403——0.3370.667—
Mem0Backbone=GPT-4.1-mini2026.050.403——0.3370.569—
MemoryOSBackbone=GPT-4.12026.050.398——0.2850.427—
A-MemModel=GPT-4o, Token Length=1,2162026.040.3941——0.3123——
MemoryOSBackbone=GPT-4.1-mini2026.050.365——0.2740.377—
HeLa-MemModel=Qwen2.5-14b, Token Length=9442026.040.3608——0.2991——
A-MEM+AMAModel=GPT-4o-mini2026.010.347——0.31——
A-MEMModel=GPT-4o-mini2026.010.331——0.293——
MemoryOSModel=Qwen2.5-14b2026.040.3224——0.2786——
LightMemModel=Qwen2.5-14b2026.040.3203——0.277——
MEM0Model=Qwen2.5-14b2026.040.2896——0.2624——
A-MemModel=Qwen2.5-14b, Token Length=1,3002026.040.2719——0.2205——
MemGPTModel=GPT-4o-mini2026.010.2552——0.1944——
MemGPTModel=GPT-4o-mini, Token Length=16,9772026.040.2552——0.1944——
HeLa-MemModel=Qwen2.5-3b, Token Length=1,0722026.040.2479——0.2135——
LightMemBackbone=GPT-4.12026.050.246——0.2040.662—
A-MemModel=Qwen2.5-3b, Token Length=1,3002026.040.2432——0.1974——
Zep*2026.020.2390.20.602———
ZepBackbone=GPT-4.1-mini2026.050.239——0.20.602—
Vanilla LLMModel=GPT-OSS-120B2026.010.2286——0.1702——
MemoryOSModel=Qwen2.5-3b, Token Length=2,0002026.040.2085——0.1605——
LightMemBackbone=GPT-4.1-mini2026.050.206——0.1840.681—
LoCoMoModel=GPT-4o-mini2026.010.1841——0.1477——
LoCoMoModel=GPT-4o-mini, Token Length=16,9102026.040.1841——0.1477——
MemGPTModel=GPT-4o2026.010.1729——0.1318——
MemGPTModel=GPT-4o, Token Length=16,9872026.040.1729——0.1318——
ReadAgentModel=GPT-4o-mini2026.010.126——0.0887——
ReadAgentModel=GPT-4o-mini, Token Length=6432026.040.126——0.0887——
LoCoMoBackbone=GPT-4.1-mini2026.050.12——0.106——
MemoryBankModel=GPT-4o-mini2026.010.0968——0.0699——
MemoryBankModel=GPT-4o-mini, Token Length=4322026.040.0968——0.0699——
LoCoMoModel=GPT-4o2026.010.0909——0.0578——
LoCoMoModel=GPT-4o, Token Length=16,9102026.040.0909——0.0578——
ReadAgentBackbone=GPT-4.1-mini2026.050.053——0.042——
ReadAgentModel=GPT-4o2026.010.0416——0.0319——
ReadAgentModel=GPT-4o, Token Length=8052026.040.0416——0.0319——
LoCoMoModel=Qwen2.5-3b, Token Length=16,9102026.040.0311——0.0271——
ReadAgentModel=Qwen2.5-3b, Token Length=7762026.040.0301——0.0301——
MemGPTModel=Qwen2.5-3b, Token Length=16,9612026.040.0294——0.0295——
MemoryBankModel=GPT-4o2026.010.0247——0.0243——
MemoryBankModel=GPT-4o, Token Length=5692026.040.0247——0.0243——
MemoryBankModel=Qwen2.5-3b, Token Length=2982026.040.0172——0.0197——
DYNA2026.06—————0.7382
DynaGen2026.06—————0.7041
RAG2026.06—————0.6492