ResearchBenchmarksLong-context retrieval (MultiValue) on Ruler (1K to 32K Context Sweep)Follow96Retrieval Accuracy (1024 Context)BAM91.293.69698.4May 28, 2025Evaluation ResultsMethodMethodLinksRetrieval Accuracy (1024 Context)Retrieval Accuracy (1536 Context)Retrieval Accuracy (2048 Context)Retrieval Accuracy (3072 Context)Retrieval Accuracy (4096 Context)Retrieval Accuracy (6144 Context)Retrieval Accuracy (8192 Context)Retrieval Accuracy (12288 Context)Retrieval Accuracy (16384 Context)Retrieval Accuracy (24576 Context)Retrieval Accuracy (32768 Context)BAMPE=SSMax, Model Parame...PE=SSMax, Model Parameters=1B2025.05969492928284767038140RoPEPE=SSMax, Model Parame...PE=SSMax, Model Parameters=1B2025.05961001007870423210480