Needle-in-a-Haystack Retrieval on BABILong 16K context length
22.2Needle-in-a-Haystack Accuracy (16K)MemDLM (Train & Inference)
Evaluation Results
| Method | Links | |
|---|---|---|
| MemDLM (Train & Inference)Backbone=LLaDA-MoE, Setting=Train & Inference2026.03 | 22.2 | |
| MemDLM (Train-Only)Backbone=LLaDA-MoE, Setting=Train-Only2026.03 | 21 | |
| Standard MDLMBackbone=LLaDA-MoE2026.03 | 19.2 |