TREC DL
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
TREC DL 20
0.713Spearman Correlation
20
TREC DL 19
0.636Spearman Correlation
20
TREC DL 2019 (test)
74.4NDCG@10
20
TREC DL 2023
47.5NDCG@10
20
TREC DL 2020 (test)
0.659nDCG@10
19
TREC DL 2019 (test)
79.77NDCG@10
19
TREC DL
83.12NDCG@5
18
TREC DL 2022
44.88NDCG@10
18
TREC DL 19 20 (test)
75.1nDCG@10
17
TREC DL21
0.538nDCG@50
15
TREC DL 2020 (test)
0.723NDCG@10
15
TREC DL 2020 (evaluation)
0.718NDCG@10
14
TREC DL 2019 (evaluation)
0.724NDCG@10
14
TREC DL
74.79NDCG@10 (DL19)
13
TREC DL 2021
69.3NDCG@10
11
TREC DL 2019 2020 Average
69.86Average NDCG@10
10
TREC DL 2019 (test)
97.6Query+
10
TREC DL 2019
97.6Query+
10
TREC DL 2022 (test)
28.56AP-τ
9
TREC DL 2021 (test)
0.287AP-τ
9
TREC-DL 2023 (test)
0.418Cohen's Kappa
9
TREC-DL 2022 (test)
0.43Cohen's Kappa
9
TREC-DL 2021 (test)
0.492Cohen's Kappa
9
TREC-DL 2020 (test)
0.455Cohen's Kappa
9
TREC-DL 2019 (test)
0.499Cohen's Kappa
9