Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Long-context retrieval research benchmarks – Page 2 · SOTA2 Research

Long-context retrieval

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

NIAH-Single-3 (256K)

76.4Accuracy

12

Jun 11, 2026

NIAH-Single-3 128K context

90.6Accuracy

12

Jun 11, 2026

NIAH-Single-3 64K context

97Accuracy

12

Jun 11, 2026

NIAH Single 3 32K context

98.6Accuracy

12

Jun 11, 2026

NIAH-Single-2 256K context

93.4Accuracy

12

Jun 11, 2026

NIAH-Single-2 (128K context)

97Accuracy

12

Jun 11, 2026

NIAH-Single-2 64K context

100Accuracy

12

Jun 11, 2026

NIAH-Single-2 32K context

99.8Accuracy

12

Jun 11, 2026

NIAH-Single-1 256K

100Accuracy

12

Jun 11, 2026

NIAH-Single-1 128K

100Accuracy

12

Jun 11, 2026

NIAH-Single-1 64K

100Accuracy

12

Jun 11, 2026

NIAH-Single-1 32K

100Accuracy

12

Jun 11, 2026

Llama3.1 8B Instruct

99.6Exact Match Accuracy

12

May 8, 2026

92.97Score

12

May 28, 2026

NarrativeQA LongEmbed

71.5nDCG@10

11

Jun 23, 2026

0.783nDCG@10

11

Jun 23, 2026

Multi-task NIAH 4K–128K context lengths Llama-3.1-8B-Instruct

100Accuracy (Single)

10

Jun 24, 2026

NIAH (Needle In A Haystack) Multi-task Qwen2.5-7B

96Accuracy (Single)

10

Jun 24, 2026

QMSum LongEmbed

0.813nDCG@10

9

Jun 23, 2026

SummScreen LongEmbed

98.1nDCG@10

9

Jun 23, 2026

2WikiMQA LongEmbed

96.5nDCG@10

9

Jun 23, 2026

RULER-NIAH 128k

97.2Accuracy

9

May 19, 2026

98.8Accuracy

9

May 19, 2026

100Accuracy

9

May 19, 2026

100Accuracy

9

May 19, 2026

Page 2 of 4

Popular datasets

RULER NIAH Needle-in-a-Haystack RULER-NIAH NIAH-Single

Follow for updates

Join SOTA2 Contact