MRCR
Benchmarks
TaskDatasetSOTA resultTrendResults
MRCR
89.7Score
25
MRCR
75.3Accuracy
15
MRCR OOD 8-128K
96.6Accuracy (8-16K)
10
MRCR ID 4-8K
99.8Accuracy
10
MRCR
38MRCR 2-Needle Success
9
MRCR 16K-256K
80.37Score
8
MRCR
81.62-Needle Score
8
MRCR v2
66.4Accuracy
6
MRCR 512K~1M
46.88Score
6
MRCR 128K~512K
53.98Score
6
MRCR
92.3Accuracy
6
MRCR v2
89.4Score
5
MRCR v2
94.8Score
5
MRCR
0.77pass@1
5
MRCR 8-needle v2
79Score
4
MRCR-8needle 100-example
27.9Sequence Match Accuracy
4