Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Long-context retrieval research benchmarks – Page 3 · SOTA2 Research

Long-context retrieval

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

100Accuracy

9

May 19, 2026

RULER 8k context NIAH Single 1

100Accuracy

9

May 19, 2026

100S1 Score

9

Apr 20, 2026

RULER Multi-Key (test)

99.5Accuracy (4K Context)

8

Jun 19, 2026

100Accuracy (1024 tokens)

8

May 21, 2026

100Accuracy (1024)

8

May 21, 2026

NIAH (Needle-In-A-Haystack) Retrieval Variants long-context

100Single-1 Acc (1K)

8

Apr 10, 2026

RULER 4K-32K context

95.73Accuracy

8

Feb 26, 2026

85.4Document Avg

8

Feb 26, 2026

Qwen2.5-14B-Instruct-1M

100Score (4k Context)

7

Feb 26, 2026

66.4Accuracy

6

Jul 7, 2026

BrowseComp-Plus

MPE-Rand[32, 1024]

15.3nDCG@10

6

Jun 23, 2026

99NIAH Score

6

Feb 26, 2026

98.6NIAH Score

6

Feb 26, 2026

100Multi-needle Avg Recall

6

Feb 26, 2026

100Accuracy

5

Mar 12, 2026

Needle-in-a-Haystack 1.0 (test)

99.9Score

5

Feb 26, 2026

60SQuAD Score

3

May 28, 2026

Runtime-Certified Bounded-Error Quantized Attention

0Delta Accuracy (Δacc)

3

May 21, 2026

Needle-in-a-Haystack (NiH)

100Accuracy (512 tokens)

3

Feb 26, 2026

Nemotron-3-Ultra 550B-A55B-Base

86.22Score

2

Jun 16, 2026

RULER 32k context NIAH Single 1

1Score

2

May 15, 2026

RULER 16k context NIAH Single 1

1Score

2

May 15, 2026

RULER 4k context NIAH Single 1

1Score

2

May 15, 2026

S2: S1 → SFT(2) 60B Targeted (all-attention)

100NIAH Score

2

Apr 23, 2026

Page 3 of 4

Popular datasets

RULER NIAH Needle-in-a-Haystack RULER-NIAH NIAH-Single

Follow for updates

Join SOTA2 Contact