Multi-needle retrieval on MRCR-8needle 100-example
27.9Sequence Match AccuracyInfoMem
Evaluation results
| Method | Links | |
|---|---|---|
| InfoMembase_model=Qwen2.5-1.5B-Instruct, beta=0.22026.06 | 27.9 | |
| Qwen2.5-1.5B-Instructstatus=Base Model2026.06 | 26 | |
| ReMemR1base_model=Qwen2.5-1.5B-Instruct, retrieval=callback retrieval, framework=chunk-wise memory-agent2026.06 | 9.2 | |
| Outcome-only GRPObase_model=Qwen2.5-1.5B-Instruct2026.06 | 6.3 |