NQ
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
NQ
81ASR
30
NQ
60RACC
29
NQ
52.76MRR
29
NQ (test)
59.1Unreliability Rate
28
NQ
39.5EM
28
NQ
3ASR
28
NQ
49.86EM (%)
27
NQ
100ASR
24
NQ
96.74SASR
24
NQ
90ASR (Substring)
24
NQ simplified
41Naïve Success Rate
24
NQ k=5 OOD (test)
0.248ECE
24
NQ
77.1Accuracy
23
NQ 320k (test)
63.4Hits@1
23
NQ 100K
27.5Hits@1
23
NQ10K
48.5Hits@1
23
NQ (test)
48.9Accuracy
22
NQ
61.2Accuracy (Acc)
22
NQ
58.31EM Accuracy (@5)
21
NQ
42Success Rate
21
NQ
64.4NDCG@10 (Dense)
21
NQ-Open
0.753AUCs
21
NQ
4.68ECE@1
21
NQ
0.908Faith
21
NQ D_special (test)
27.65r_pri
20