Needle-in-a-Haystack
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
100Accuracy
44
Feb 26, 2026
100Accuracy
35
Apr 14, 2026
1Accuracy
25
Feb 26, 2026
84Accuracy
13
Feb 26, 2026
57.2Success Rate @ 0% Insertion
7
Feb 26, 2026
100NIAH Success Rate (32K Context)
6
Feb 26, 2026
79.69Success Rate (1k Context)
5
Feb 26, 2026
79.61NIAH-2 Success Rate (1k)
5
Feb 26, 2026
2.8Precision
4
May 7, 2026
52.2Accuracy
4
Feb 26, 2026
74.92Needle-in-a-haystack Accuracy (2x Context)
4
Feb 26, 2026