TREC-COVID
Benchmarks
TaskDatasetSOTA resultTrendResults
TREC-COVID
87NDCG@10
59
TREC-COVID BEIR
95NDCG@10
27
TREC-COVID
0.893AUC
20
TREC-COVID v1 (test)
54.4CR
12
TREC-COVID
95.2Recall
10
TREC-COVID (test)
73.8NDCG@10
9
TREC-COVID CORD-19 (Round 4)
0.784nDCG@20
7
TREC-COVID Round 5 (Expert 50)
82.82nDCG@10
6
TREC-COVID Para C - Keyword-heavy graded
80.8nDCG@10
5
TREC-COVID Para B Semi-technical graded
71.5nDCG@10
5
TREC-COVID Conversational graded (Para A)
76.3nDCG@10
5
TREC-COVID Expert 50 graded
82.8nDCG@10
5
TREC-COVID
100MRR
5
TREC-COVID (test)
0.319MAP
5
TREC-COVID CORD-19 (Round 2)
68.93nDCG@10
5
TREC-COVID Biomedical
1MRR
4
TREC-COVID
85.64QPS
4
TREC-COVID (logs)
0.908Mean Score (Head)
3
TREC-COVID
64.36NDCG@10
3
TREC-COVID
38.39Success Rate
3
TREC-COVID BEIR v1.0 (test)
0.705NDCG@10
2
TREC-COVID BEIR
0.35Latency (ms)
2
TREC-COVID BEIR
0.572MRR@10
1
TREC-COVID
6.05H2D Latency (ms)
1
TREC-COVID (test)
—Primary metric
0