Needle-in-a-Haystack (NIAH) retrieval on BABILong 4K
61.2AccuracyMemDLM (Train & Inference)
Evaluation Results
| Method | Links | |
|---|---|---|
| MemDLM (Train & Inference)Backbone=LLaDA2.12026.03 | 61.2 | |
| MemDLM (Train-Only)Backbone=LLaDA2.12026.03 | 58.5 | |
| MemDLM (Train & Inference)Backbone=LLaDA-MoE2026.03 | 51.2 | |
| MemDLM (Train-Only)Backbone=LLaDA-MoE2026.03 | 50.6 | |
| Standard MDLMBackbone=LLaDA2.12026.03 | 48.8 | |
| Standard MDLMBackbone=LLaDA-MoE2026.03 | 45.6 |