Needle-in-a-Haystack (NIAH) retrieval on BABILong 8K
57AccuracyMemDLM (Train & Inference)
Evaluation Results
| Method | Links | |
|---|---|---|
| MemDLM (Train & Inference)Backbone=LLaDA2.12026.03 | 57 | |
| MemDLM (Train-Only)Backbone=LLaDA2.12026.03 | 55 | |
| Standard MDLMBackbone=LLaDA2.12026.03 | 47.4 | |
| MemDLM (Train & Inference)Backbone=LLaDA-MoE2026.03 | 47 | |
| MemDLM (Train-Only)Backbone=LLaDA-MoE2026.03 | 45.6 | |
| Standard MDLMBackbone=LLaDA-MoE2026.03 | 41.8 |