ResearchBenchmarksLong-context retrieval (MultiKey 3) on Ruler (1K to 32K Context Sweep)Follow18Retrieval Accuracy (1024 Tokens)RoPE11.7613.381516.62May 28, 2025Evaluation ResultsMethodMethodLinksRetrieval Accuracy (1024 Tokens)Retrieval Accuracy (1536 Tokens)Retrieval Accuracy (2048 Tokens)Retrieval Accuracy (3072 Tokens)Retrieval Accuracy (4096 Tokens)Retrieval Accuracy (6144 Tokens)Retrieval Accuracy (8192 Tokens)Retrieval Accuracy (12288 Tokens)Retrieval Accuracy (16384 Tokens)Retrieval Accuracy (24576 Tokens)Retrieval Accuracy (32768 Tokens)RoPEPE=SSMax, Model Parame...PE=SSMax, Model Parameters=1B2025.05180000000000BAMPE=SSMax, Model Parame...PE=SSMax, Model Parameters=1B2025.05124000000000