NIAH-Single
Benchmarks
TaskDatasetSOTA resultTrendResults
NIAH-Single-2 256K context
95.2Accuracy
23
NIAH-Single 128K context 2
98.6Accuracy
23
NIAH-Single-1 32K context
100Accuracy (NIAH-Single-1 32K)
23
NIAH-Single-3 (256K)
76.4Accuracy
12
NIAH-Single-2 (128K context)
97Accuracy
12
NIAH-Single-2 64K context
100Accuracy
12
NIAH-Single-2 32K context
99.8Accuracy
12
NIAH-Single-1 64K
100Accuracy
12