Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Long-context Memory Evaluation research benchmarks · SOTA2 Research

Long-context Memory Evaluation

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

95.6Average Score

103

Jun 2, 2026

81F1 Score

35

Apr 2, 2026

61.56Single-Hop F1

21

Jul 2, 2026

75Overall Score

12

Feb 26, 2026

87.5Recall

10

May 15, 2026

89.6Accuracy

9

Apr 27, 2026

LongMemEval v0.6.0 (strict)

92Accuracy

7

May 7, 2026

BEHEMOTH LongMemEval (out-of-distribution)

63.07Accuracy

6

Apr 14, 2026

39.39SingleHop F1

3

Jul 2, 2026

LongMemEval-S (seed 101)

0.01Delta

1

Jun 11, 2026

LongMemEval-S (seed 5)

0.1Delta

1

Jun 11, 2026

LongMemEval-S (seed 23)

0.05Delta Score

1

Jun 11, 2026

LongMemEval-S (Seed 11)

0.06Delta

1

Jun 11, 2026

LongMemEval-S Seed 7 (Run 3)

0.08Delta

1

Jun 11, 2026

Popular datasets

LongMemEval Locomo MemBench Mem-Gallery BEHEMOTH

Follow for updates

Join SOTA2 Contact