BEIR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
BEIR
80.87SF
13
BEIR top-60
77.9TREC-COVID Score
13
BEIR
0.36nDCG@1 (NFC)
13
BEIR zero-shot
77.2TREC-COVID
13
BEIR 11 Tasks
55.7nDCG@10 (Overall)
12
BEIR
55.1Average NDCG@10
12
BEIR 1.0.0 (test)
84.63Covid Reranking Score
11
BEIR (test)
85.99Covid
11
BEIR TREC-News
51.6nDCG@10
10
BEIR FiQA
28.4nDCG@10
10
BEIR scidocs (test)
0.266nDCG@10
10
BEIR Covid, DBPedia, SciFact, NFCorpus, Signal, Robust04, News Average
55.44NDCG@10
8
BEIR
44.3FiQA Score
8
NanoBEIR
71.58NDCG@10
8
BEIR unseen 8 subsets (test)
48.16nDCG@10
7
BEIR RobustQA
94.1Class-wise Recall (Irrelevance)
7
BEIR BM25 Top-100 initial retrieval
84.7TREC-COVID Score
7
BEIR NFCorpus
0.022Δ nDCG@10
6
BEIR
76.83COVID Score
6
BEIR Average of ArguAna, Quora, and Scidocs
67nDCG
6
BEIR
80Mean Coverage (90% Overlap@1)
6
BEIR 15 (test)
38.7NDCG@10
6
BEIR quora (test)
91.99nDCG@10
5
BEIR arguana (test)
62.14nDCG@10
5
BEIR scifact (test)
99.35nDCG@10
5