Knowledge Incorporation on SQuAD Single Passage n=1
48.9AccuracySleep (Transformer + four-level)
Evaluation Results
| Method | Links | |
|---|---|---|
| Sleep (Transformer + four-level)Memory system=Four-level2026.06 | 48.9 | |
| Sleep (Transformer)Memory system=Two-level2026.06 | 48.1 | |
| removing random expertAblation=Random expert removed2026.06 | 48 | |
| removing gradient-based selectionAblation=Gradient-based selection removed2026.06 | 47.1 | |
| SEAL2026.06 | 46.7 | |
| removing DreamingAblation=Dreaming phase removed2026.06 | 35.7 | |
| Fine-tuned Model with No Dreaming2026.06 | 33.4 | |
| Base model2026.06 | 31.9 |