Needle-in-a-Haystack Retrieval on RULER 32K context length
15.35RULER-MV Retrieval ScoreMemDLM (Train & Inference)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| MemDLM (Train & Inference)Backbone=LLaDA-MoE, Setting=Train & Inference2026.03 | 15.35 | 11.44 | 24.48 | |
| MemDLM (Train-Only)Backbone=LLaDA-MoE, Setting=Train-Only2026.03 | 15.2 | 10.35 | 22.48 | |
| Standard MDLMBackbone=LLaDA-MoE2026.03 | 14.3 | 9.48 | 17.82 |