Needle-in-a-Haystack Retrieval on BABILong 32K context length
9AccuracyMemDLM (Train & Inference)
Evaluation Results
| Method | Links | |
|---|---|---|
| MemDLM (Train & Inference)Backbone=LLaDA-MoE, Setting=Train & Inference2026.03 | 9 | |
| MemDLM (Train-Only)Backbone=LLaDA-MoE, Setting=Train-Only2026.03 | 8.5 | |
| Standard MDLMBackbone=LLaDA-MoE2026.03 | 6.8 |