BEIR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
BEIR nfcorpus (test)
83.13nDCG@10
5
BEIR zero-shot
0.342NFCorpus Score
5
BeIR nq, hotpotqa, scifact (mixed workload)
94.28Recall@10
5
BeIR Mixed (NQ, HotpotQA, SciFact)
94.28Recall@10
5
BEIR
42.5nDCG@10 (ArguAna)
5
BEIR (out-domain)
56.8Arguana
5
BEIR small
42.7NDCG@10 (Average)
4
BEIR DBPedia out-domain
49.2nDCG@10
4
BEIR COVID (out-domain)
85.5nDCG@10
4
BEIR TREC-COVID
80.3nDCG@10
3
BEIR FiQA
54.5nDCG@10
3
BEIR SciFact
65.1nDCG@10
3
BEIR SciFact
0.645NDCG@10
3
BEIR BM25 Top-1000 initial retrieval
82.1TREC-COVID
3