Reranking on TREC (NDCG@5)
74.45NDCG@5 (DL19)Cross-Encoder + LCR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Cross-Encoder + LCRRetriever=Contriever, Reranker=Cross-Encoder, LCR Enhancement=LCR, Query Threshold (QT)=true2026.02 | 74.45 | 61.29 | 67.87 | |
| Cross-Encoder + LCR w/o QTRetriever=Contriever, Reranker=Cross-Encoder, LCR Enhancement=LCR, Query Threshold (QT)=false2026.02 | 73.73 | 61.01 | 67.37 | |
| ColBERT + LCRRetriever=Contriever, Reranker=ColBERT, LCR Enhancement=LCR, Query Threshold (QT)=true2026.02 | 73.47 | 60.39 | 66.93 | |
| RankT5 + LCRRetriever=Contriever, Reranker=RankT5, LCR Enhancement=LCR, Query Threshold (QT)=true2026.02 | 73.36 | 61.3 | 67.33 | |
| Cross-EncoderRetriever=Contriever, Reranker=Cross-Encoder, Reranker Category=Fine-tuned Transformer, LCR Enhancement=None2026.02 | 72.96 | 60.89 | 66.92 | |
| RankT5 + LCR w/o QTRetriever=Contriever, Reranker=RankT5, LCR Enhancement=LCR, Query Threshold (QT)=false2026.02 | 72.86 | 61.15 | 67 | |
| ColBERT + LCR w/o QTRetriever=Contriever, Reranker=ColBERT, LCR Enhancement=LCR, Query Threshold (QT)=false2026.02 | 72.78 | 60.3 | 66.54 | |
| ColBERTRetriever=Contriever, Reranker=ColBERT, Reranker Category=Fine-tuned Transformer, LCR Enhancement=None2026.02 | 71.93 | 60.3 | 66.12 | |
| RankT5Retriever=Contriever, Reranker=RankT5, Reranker Category=Fine-tuned Transformer, LCR Enhancement=None2026.02 | 71.66 | 61.03 | 66.34 | |
| YesNo + LCRRetriever=Contriever, Reranker=YesNo, LCR Enhancement=LCR, Query Threshold (QT)=true2026.02 | 70.89 | 53.73 | 62.31 | |
| YesNo + LCR w/o QTRetriever=Contriever, Reranker=YesNo, LCR Enhancement=LCR, Query Threshold (QT)=false2026.02 | 70.88 | 53.17 | 62.02 | |
| YesNoRetriever=Contriever, Reranker=YesNo, Reranker Category=Pre-trained LLM, LCR Enhancement=None2026.02 | 69.9 | 52.85 | 61.37 | |
| Contriever + LCRRetriever=Contriever, Reranker=None, LCR Enhancement=LCR, Query Threshold (QT)=true2026.02 | 69.79 | 47.1 | 58.45 | |
| RankGPT + LCRRetriever=Contriever, Reranker=RankGPT, LCR Enhancement=LCR, Query Threshold (QT)=true2026.02 | 69.79 | 47.1 | 58.45 | |
| Contriever + LCR w/o QTRetriever=Contriever, Reranker=None, LCR Enhancement=LCR, Query Threshold (QT)=false2026.02 | 69.74 | 47.1 | 58.42 | |
| RankGPT + LCR w/o QTRetriever=Contriever, Reranker=RankGPT, LCR Enhancement=LCR, Query Threshold (QT)=false2026.02 | 69.74 | 47.1 | 58.42 | |
| ContrieverRetriever=Contriever, Reranker=None, LCR Enhancement=None2026.02 | 68.58 | 45.75 | 57.17 | |
| RankGPTRetriever=Contriever, Reranker=RankGPT, Reranker Category=Pre-trained LLM, LCR Enhancement=None2026.02 | 68.58 | 45.75 | 57.17 | |
| QLM + LCRRetriever=Contriever, Reranker=QLM, LCR Enhancement=LCR, Query Threshold (QT)=true2026.02 | 68.48 | 47.83 | 58.15 | |
| QLM + LCR w/o QTRetriever=Contriever, Reranker=QLM, LCR Enhancement=LCR, Query Threshold (QT)=false2026.02 | 68.21 | 47.83 | 58.02 | |
| QLMRetriever=Contriever, Reranker=QLM, Reranker Category=Pre-trained LLM, LCR Enhancement=None2026.02 | 65.77 | 44.6 | 55.19 | |
| RankT5Reranker Type=Fine-tuned Transformer Based, LCR Enhancement=false, Base Retriever=BM252026.02 | 65.48 | 60.65 | 63.06 | |
| RankT5 + LCRReranker Type=Fine-tuned Transformer Based, LCR Enhancement=true, Base Retriever=BM252026.02 | 65.48 | 60.78 | 63.13 | |
| Cross-EncoderReranker Type=Fine-tuned Transformer Based, LCR Enhancement=false, Base Retriever=BM252026.02 | 65.08 | 59.83 | 62.45 | |
| Cross-Encoder + LCRReranker Type=Fine-tuned Transformer Based, LCR Enhancement=true, Base Retriever=BM252026.02 | 65.08 | 59.86 | 62.47 | |
| ColBERTReranker Type=Fine-tuned Transformer Based, LCR Enhancement=false, Base Retriever=BM252026.02 | 63.77 | 60.74 | 62.26 | |
| ColBERT + LCRReranker Type=Fine-tuned Transformer Based, LCR Enhancement=true, Base Retriever=BM252026.02 | 63.77 | 60.74 | 62.26 | |
| YesNo + LCRReranker Type=Pre-trained LLM Based, LCR Enhancement=true, Base Retriever=BM252026.02 | 59.74 | 55.15 | 57.44 | |
| YesNoReranker Type=Pre-trained LLM Based, LCR Enhancement=false, Base Retriever=BM252026.02 | 59.25 | 54.85 | 57.05 | |
| QLM + LCRReranker Type=Pre-trained LLM Based, LCR Enhancement=true, Base Retriever=BM252026.02 | 55.63 | 48.98 | 52.3 | |
| BM25 + LCRReranker Type=Retriever-Only, LCR Enhancement=true, Base Retriever=BM252026.02 | 54.31 | 51.12 | 52.71 | |
| RankGPT + LCRReranker Type=Pre-trained LLM Based, LCR Enhancement=true, Base Retriever=BM252026.02 | 54.31 | 51.03 | 52.67 | |
| QLMReranker Type=Pre-trained LLM Based, LCR Enhancement=false, Base Retriever=BM252026.02 | 53.41 | 48.15 | 50.78 | |
| BM25Reranker Type=Retriever-Only, LCR Enhancement=false, Base Retriever=BM252026.02 | 52.78 | 50.67 | 51.72 | |
| RankGPTReranker Type=Pre-trained LLM Based, LCR Enhancement=false, Base Retriever=BM252026.02 | 52.78 | 50.67 | 51.72 |