Information Retrieval on Needle In A Haystack (Context/Position Specific)
3Retrieval Success (d=1)KV-Fold
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| KV-Foldpeak GPU=35.6 GB, total wall=166 s, T (Context Length)=128K, chain depth=511, Backbone=Llama-3.1-8B-Instruct2026.05 | 3 | 3 | 3 | 2 | |
| StreamingLLMpeak GPU=16.6 GB, total wall=22 s, T (Context Length)=128K, chain depth=511, Backbone=Llama-3.1-8B-Instruct2026.05 | 3 | 0 | 0 | 0 |