Multi-hop Question Answering on PopQA
38.36AccuracyQwen2.5-7B-Instruct + MemTrain + MEM1
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen2.5-7B-Instruct + MemTrain + MEM1Backbone=Qwen2.5-7B-Instruct, Memory Tool=MEM1, Training=MemTrain2026.06 | 38.36 | |
| Qwen3-4B-Instruct-2507 + MemTrain + MEM1Backbone=Qwen3-4B-Instruct-2507, Memory Tool=MEM1, Training=MemTrain2026.06 | 37.91 | |
| Qwen2.5-7B-Instruct + MEM1Backbone=Qwen2.5-7B-Instruct, Memory Tool=MEM12026.06 | 27.13 | |
| Qwen3-4B-Instruct-2507 + MEM1Backbone=Qwen3-4B-Instruct-2507, Memory Tool=MEM12026.06 | 23.62 | |
| Qwen3-4B-Instruct-2507Backbone=Qwen3-4B-Instruct-25072026.06 | 21.81 | |
| Qwen2.5-7B-InstructBackbone=Qwen2.5-7B-Instruct2026.06 | 12.59 |