ResearchBenchmarksIn-context retrieval on RULER 2MFollow97S-NHiLS-Attn-HoPE92.1594.5759799.425Jul 3, 2026Evaluation ResultsMethodMethodLinksS-NMK-MQVTHiLS-Attn-HoPEParameters=345M, Train...Parameters=345M, Training context length=8K2026.07978750