Memory Extraction on HaluMem
95.66Memory AccuracyMemReader-0.6B
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| MemReader-0.6BModel Scale=0.6B2026.04 | 95.66 | — | 88.4 | 91.38 | 99.82 | 33.84 | 93.76 | |
| Memobase2026.01 | 92.24 | 14.55 | — | — | — | — | — | |
| MemReader-4B-GRPOModel Scale=4B, Training=GRPO2026.04 | 91.98 | — | 96.57 | 97.19 | 99.91 | 19.18 | 98.21 | |
| MemReader-4B-SFTModel Scale=4B, Training=SFT2026.04 | 91.31 | — | 93.56 | 95.49 | 99.86 | 18.24 | 96.61 | |
| Supermemory2026.01 | 90.32 | 41.53 | — | — | — | — | — | |
| ProMemBackbone LLM=GPT-4o-mini2026.01 | 89.47 | 73.8 | — | — | — | — | — | |
| AtomMem2026.06 | 87.5 | — | 0.28 | 0.39 | — | — | 0.56 | |
| Mem02026.01 | 86.26 | 42.91 | — | — | — | — | — | |
| MemAgent2026.06 | 82.02 | — | 12.39 | 15.31 | — | — | 22.03 | |
| TRUSTMEM2026.06 | 67.81 | — | 56.73 | 67.45 | — | — | 69.45 | |
| Mem-T2026.06 | 67.13 | — | 36.6 | 46.85 | — | — | 52.69 | |
| Mem0-Graph2026.04 | 61.86 | — | 43.28 | 65.52 | 87.2 | 55.7 | 57.85 | |
| Mem02026.04 | 60.86 | — | 42.91 | 65.03 | 86.26 | 56.8 | 57.31 | |
| Mem02026.06 | 60.86 | — | 42.91 | 65.03 | — | — | 57.31 | |
| Supermemory2026.04 | 60.83 | — | 41.53 | 64.76 | 90.32 | 51.77 | 56.9 | |
| Supermemory2026.06 | 60.83 | — | 41.53 | 64.76 | — | — | 56.9 | |
| MemOS2026.04 | 59.55 | — | 74.07 | 84.81 | 86.25 | 44.94 | 79.7 | |
| Memobase2026.04 | 32.29 | — | 14.55 | 25.88 | 92.24 | 80.78 | 25.13 | |
| Memobase2026.06 | 32.29 | — | 14.55 | 25.88 | — | — | 25.13 |