Long-range retrieval accuracy on NIAH 32K
90.9AccuracySoft-NBCE
Evaluation results
| Method | Links | |
|---|---|---|
| Soft-NBCEMem=O(L^2/n), zero-shot=false, distillation=true2026.05 | 90.9 | |
| Vanilla NBCEMem=O(L^2/n)2026.05 | 79.1 | |
| Truncated (8K)Mem=O(L^2)2026.05 | 65.9 | |
| PCWMem=O(L^2/n)2026.05 | 0 |