Retrieval on RULER 64K context length
84.29AccuracyWindowed-4K
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Windowed-4KSetup=Windowed, Comp.=0.25, Model=Llama-3.1-8B-Instruct2026.02 | 84.29 | — | |
| Windowed-8KSetup=Windowed, Comp.=0.25, Model=Llama-3.1-8B-Instruct2026.02 | 83.92 | — | |
| KeyDiffSetup=Windowed, Comp.=0.25, Model=Llama-3.1-8B-Instruct2026.02 | 81.09 | — | |
| Global ManifoldKVSetup=Global, Comp.=0.25, Model=Llama-3.1-8B-Instruct2026.02 | 35.2 | — | |
| MrRoPE-ProModel=Qwen2.5-3B-Instruct, Scale Setting=32K → 128K, Extension Method=MrRoPE-Pro2026.01 | — | 70.4 | |
| YaRNModel=Qwen2.5-3B-Instruct, Scale Setting=32K → 128K, Extension Method=YaRN2026.01 | — | 63.2 |