ResearchBenchmarksLong-context retrieval (MultiKey 1) on Ruler (1K to 32K Context Sweep)Long-context retrieval (MultiKey 1) on Ruler (1K to 32K Context Sweep)Follow84Ruler Retrieval Acc (1024 tokens)BAM79.8480.928283.08May 28, 2025Evaluation resultsMethodMethodLinksRuler Retrieval Acc (1024 tokens)Ruler Retrieval Acc (1536 tokens)Ruler Retrieval Acc (2048 tokens)Ruler Retrieval Acc (3072 tokens)Ruler Retrieval Acc (4096 tokens)Ruler Retrieval Acc (6144 tokens)Ruler Retrieval Acc (8192 tokens)Ruler Retrieval Acc (12288 tokens)Ruler Retrieval Acc (16384 tokens)Ruler Retrieval Acc (24576 tokens)Ruler Retrieval Acc (32768 tokens)BAMPE=SSMax, Model Parame...PE=SSMax, Model Parameters=1B2025.05848694928676665624106RoPEPE=SSMax, Model Parame...PE=SSMax, Model Parameters=1B2025.058086683832860000