List your company
ResearchFormerly WizWand

Document Reranking on TREC DL 2019 (test)

74.4NDCG@10EviRerankBM25
47.77654.68861.668.512Nov 9, 2024
Updated 5mo ago

Evaluation results

MethodLinks
EviRerankBM25Model Category=Ours: EviRerank (AEB+SA), Selector=BM252024.1174.430.2
EviRerankcrossModel Category=Ours: EviRerank (AEB+SA), Selector=cross2024.1174.330.7
EviRerankbiModel Category=Ours: EviRerank (AEB+SA), Selector=bi2024.1174.330
RankLLaMAModel Category=LLM2024.1170.128.8
KeyB(BERT)BinBModel Category=Select blocks models, Selector=BinB2024.1169.728.3
RankLLaMA-prefixModel Category=LLM, pmax=6002024.1169.228.1
KeyB(BERT)BM25Model Category=Select blocks models, Selector=BM252024.1168.328.1
IDCMModel Category=Select blocks models2024.1167.927.3
KeyB(PARADE5)BinB2Model Category=Select blocks models, Selector=BinB22024.1167.827.9
KeyB(PARADE5)BinBModel Category=Select blocks models, Selector=BinB2024.1167.627.7
KeyB(PARADE5)BM25Model Category=Select blocks models, Selector=BM252024.1167.228
QDS-TransformerModel Category=Sparse attention models2024.1166.727.8
PARADEModel Category=Baseline models2024.1165.528
RankLLaMA-AvgPModel Category=LLM, Aggregation Strategy=AvgP2024.1165.426.4
Transformer-XHModel Category=Sparse attention models2024.1164.625.6
TKLModel Category=Baseline models2024.1164.427.7
RankLLaMA-MaxPModel Category=LLM, Aggregation Strategy=MaxP2024.1164.326.9
Sparse-TransformerModel Category=Sparse attention models2024.1163.425.7
Longformer-QAModel Category=Sparse attention models2024.1162.725.5
BM25Model Category=Baseline models2024.1148.823.4