List your company
ResearchFormerly WizWand

Long-context Question Answering on 2WikiMultiHopQA (Out-Of-Distribution)

63.9AccuracyReMemR1
-2.55614.69731.9549.203Sep 27, 2025
Updated 8mo ago

Evaluation results

MethodLinks
ReMemR1Scale=7B, Number of Context Documents=502025.0963.9
ReMemR1Scale=7B, Number of Context Documents=1002025.0963.1
Qwen2.5-1MScale=7B, Number of Context Documents=502025.0962.5
MemAgentScale=7B, Number of Context Documents=502025.0961.7
Qwen2.5Scale=7B, Number of Context Documents=2002025.0961.1
Qwen2.5-1MScale=7B, Number of Context Documents=1002025.0959.4
Qwen2.5-1MScale=7B, Number of Context Documents=2002025.0957.8
MemAgentScale=7B, Number of Context Documents=1002025.0957.8
ReMemR1Scale=7B, Number of Context Documents=2002025.0955.6
ReMemR1Scale=7B, Number of Context Documents=8002025.0954.7
ReMemR1Scale=7B, Number of Context Documents=4002025.0954.5
Qwen2.5Scale=7B, Number of Context Documents=502025.0953.9
ReMemR1Scale=3B, Number of Context Documents=502025.0953.5
MemAgentScale=7B, Number of Context Documents=2002025.0950.8
MemAgentScale=7B, Number of Context Documents=8002025.0950.7
ReMemR1Scale=3B, Number of Context Documents=1002025.0950.4
ReMemR1Scale=7B, Number of Context Documents=64002025.0950.3
Qwen2.5Scale=7B, Number of Context Documents=1002025.0949.2
ReMemR1Scale=7B, Number of Context Documents=32002025.0948.9
Qwen2.5-1MScale=7B, Number of Context Documents=4002025.0947.7
MemAgentScale=7B, Number of Context Documents=4002025.0947.6
MemAgentScale=7B, Number of Context Documents=32002025.0946.9
Qwen2.5-1MScale=7B, Number of Context Documents=8002025.0946.1
ReMemR1Scale=7B, Number of Context Documents=16002025.0945.4
MemAgentScale=3B, Number of Context Documents=1002025.0945.3
Qwen2.5-1MScale=7B, Number of Context Documents=16002025.0945.3
MemAgentScale=7B, Number of Context Documents=64002025.0944.7
MemAgentScale=7B, Number of Context Documents=16002025.0944.5
ReMemR1Scale=3B, Number of Context Documents=2002025.0942.5
ReMemR1Scale=3B, Number of Context Documents=4002025.0941.7
MemAgentScale=3B, Number of Context Documents=502025.0941.4
MemAgentScale=3B, Number of Context Documents=2002025.0940.2
Qwen2.5Scale=3B, Number of Context Documents=502025.0939.8
MemAgentScale=3B, Number of Context Documents=4002025.0939.4
Qwen2.5Scale=3B, Number of Context Documents=1002025.0939.1
Qwen2.5Scale=3B, Number of Context Documents=2002025.0939
ReMemR1Scale=3B, Number of Context Documents=64002025.0937.8
ReMemR1Scale=3B, Number of Context Documents=8002025.0937
R1-Distill-QwenScale=7B, Number of Context Documents=502025.0936.7
MemAgentScale=3B, Number of Context Documents=8002025.0936.3
ReMemR1Scale=3B, Number of Context Documents=16002025.0936.2
ReMemR1Scale=3B, Number of Context Documents=32002025.0935.4
R1-Distill-QwenScale=7B, Number of Context Documents=1002025.0929.7
MemAgentScale=3B, Number of Context Documents=16002025.0928.9
MemAgentScale=3B, Number of Context Documents=32002025.0926.7
MemAgentScale=3B, Number of Context Documents=64002025.0925.9
R1-Distill-QwenScale=7B, Number of Context Documents=2002025.0925.8
Qwen2.5-1MScale=7B, Number of Context Documents=32002025.0925.8
R1-Distill-QwenScale=7B, Number of Context Documents=16002025.092.3
R1-Distill-QwenScale=7B, Number of Context Documents=32002025.092.3
R1-Distill-QwenScale=7B, Number of Context Documents=8002025.090.8
R1-Distill-QwenScale=7B, Number of Context Documents=64002025.090.8
R1-Distill-QwenScale=7B, Number of Context Documents=4002025.090
Qwen2.5-1MScale=7B, Number of Context Documents=64002025.090