Trec
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
TREC50
0.1Normalized Generalization Error
20
TREC DL21
0.486Spearman Correlation
20
TREC
0.99AUC
20
TREC Title queries 1-3
0.287MAP
19
trec6
95.5AUROC
18
TREC (test)
95.5Top-20 Accuracy
17
TREC DL'19 and DL'20 (2-fold)
41.76AP (τ)
16
TREC DL19
68.8NDCG@10
16
Curated TREC
41.8QA-F1
16
TREC
65.2Accuracy
15
TREC DL22
42.5nDCG@50
15
TREC (train)
8,071Unique PII Items Extracted
14
TREC (train)
981Unique PII Count
14
TREC (train)
3,840Unique PII Count
14
TREC
0.938Attack Success Rate (ASR)
13
TREC-10
99.1AUROC
12
TREC-10 (test)
96.6AUAC
12
Trec Merge Imbalance pool split
93.1Balanced Acc (10% cost)
11
TREC-6
2.69TPR (0.1% FPR)
11
TREC (test)
97.8Accuracy
11
TREC 2021 (test)
0.71Precision@1
11
TREC-6 (test)
96.2Accuracy
11
TREC In-Domain
77.8Accuracy
10
TREC (train)
80.87Accuracy
10
TREC6
89.96Accuracy
10