Real-world Retrieval on Real-world recall-intensive tasks
31.6SWDEQ-Delta
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Q-DeltaModel size=340M, Context length=2K, Format=Cloze-style next-token prediction2026.06 | 31.6 | 52.3 | 22 | 48.6 | 18.4 | 33.2 | |
| Mamba2Model size=340M, Context length=2K, Format=Cloze-style next-token prediction2026.06 | 29.1 | 55.3 | 18.4 | 49.1 | 18.2 | 33.4 | |
| Gated DeltaNetModel size=340M, Context length=2K, Format=Cloze-style next-token prediction2026.06 | 29.1 | 56 | 18.9 | 48.9 | 18.2 | 34.2 | |
| DeltaNetModel size=340M, Context length=2K, Format=Cloze-style next-token prediction2026.06 | 22.9 | 51.5 | 16.7 | 45 | 15.2 | 28.2 | |
| MambaModel size=340M, Context length=2K, Format=Cloze-style next-token prediction2026.06 | 17.1 | 43.6 | 6.4 | 55.2 | 17.5 | 26.4 |