Single-Needle-in-a-Haystack on S-NIAH (test)
100Exact Match AccuracyKLA
Evaluation results
| Method | Links | |
|---|---|---|
| KLAContext Length=1K2026.05 | 100 | |
| KLAContext Length=2K2026.05 | 100 | |
| KLAContext Length=4K2026.05 | 100 | |
| KLAContext Length=8K2026.05 | 100 | |
| GDNContext Length=1K2026.05 | 98.85 | |
| GDNContext Length=8K2026.05 | 98.5 | |
| GDNContext Length=2K2026.05 | 98.25 | |
| GDNContext Length=4K2026.05 | 98.05 | |
| Mamba2Context Length=1K2026.05 | 0.1 | |
| Mamba2Context Length=8K2026.05 | 0.05 | |
| Mamba2Context Length=2K2026.05 | 0 | |
| Mamba2Context Length=4K2026.05 | 0 |