TREC DL
Benchmarks
TaskDatasetSOTA resultTrendResults
TREC-DL 23
90.6MAP@100
9
TREC-DL 22
92.5MAP@100
9
TREC-DL 21
0.921MAP@100
9
TREC-DL 20
0.93MAP@100
9
TREC-DL 2019 1 (test)
0.946MAP@100
9
TREC DL 2020
0.804nDCG@10
8
TREC DL 2019
79.5nDCG@10
8
TREC-DL 20
71.8nDCG@10
8
TREC-DL 19
76.65nDCG@10
8
TREC DL 2020
97.74SR
8
TREC DL 2019
96.69SR
8
TREC-DL 2023
0.418Cohen's Kappa
7
TREC-DL 2022
0.425Cohen's Kappa
7
TREC-DL 2021
0.492Cohen's Kappa
7
TREC-DL 2020
0.45Cohen's Kappa
7
TREC-DL 2019
0.499Cohen's Kappa
7
TREC-DL 2023 2 (test)
0.909Kendall's tau (MAP@100)
7
TREC-DL 2022 2 (test)
0.937Kendall's tau (MAP@100)
7
TREC-DL 2021 2 (test)
0.921Kendall's tau (MAP@100)
7
TREC-DL 2020 1 (test)
0.93Kendall's tau (MAP@100)
7
TREC DL20 v1.5
0.706nDCG@10
6
TREC DL19 v1.5
72.26nDCG@10
6
TREC DL 20
0.806MRR
5
TREC DL 19
78.87MRR
5
TREC DL 20 (test)
95.7ASR
4