ResearchBenchmarksKey-Value Retrieval on InfiniteBenchKey-Value Retrieval on InfiniteBenchFollow6.2KV Retrieval Score (8k)RoPE5.896.0456.26.355Feb 5, 2026Evaluation resultsMethodMethodLinksKV Retrieval Score (8k)KV Retrieval Score (16k)KV Retrieval Score (32k)KV Retrieval Score (64k)KV Retrieval Score (128k)KV Retrieval Score (256k)RoPE2026.026.212.824.624.216.416.4HardClip2026.026.212.824.811.221.421.4CoPE2026.026.212.825.431.419.419.4