Needle-in-a-Haystack (NIAH) retrieval on RULER 8K
99.9MV Success RateMemDLM (Train & Inference)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| MemDLM (Train & Inference)Backbone=LLaDA2.12026.03 | 99.9 | 60.72 | 69.12 | |
| MemDLM (Train-Only)Backbone=LLaDA2.12026.03 | 99 | 59.15 | 68.02 | |
| Standard MDLMBackbone=LLaDA2.12026.03 | 98 | 43.72 | 67.08 | |
| MemDLM (Train & Inference)Backbone=LLaDA-MoE2026.03 | 97 | 95.8 | 61.96 | |
| MemDLM (Train-Only)Backbone=LLaDA-MoE2026.03 | 96.95 | 94.84 | 58.2 | |
| Standard MDLMBackbone=LLaDA-MoE2026.03 | 92.5 | 78.84 | 55.18 |