Reranking on BEIR (NDCG@5)
0.5106NQ NDCG@5RankT5 + LCR
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| RankT5 + LCRRetriever=Contriever, Reranker=RankT5, LCR Enhancement=LCR, Query Threshold (QT)=true2026.02 | 0.5106 | 0.3615 | 0.1391 | 0.3782 | 0.4682 | 0.8156 | 0.4455 | |
| RankT5Retriever=Contriever, Reranker=RankT5, Reranker Category=Fine-tuned Transformer, LCR Enhancement=None2026.02 | 0.5097 | 0.3592 | 0.1391 | 0.3769 | 0.4679 | 0.8156 | 0.4447 | |
| RankT5 + LCR w/o QTRetriever=Contriever, Reranker=RankT5, LCR Enhancement=LCR, Query Threshold (QT)=false2026.02 | 0.5096 | 0.3578 | 0.1389 | 0.3757 | 0.4682 | 0.8156 | 0.4443 | |
| Cross-Encoder + LCRRetriever=Contriever, Reranker=Cross-Encoder, LCR Enhancement=LCR, Query Threshold (QT)=true2026.02 | 0.4893 | 0.3244 | 0.1312 | 0.3665 | 0.4599 | 0.7846 | 0.426 | |
| Cross-EncoderRetriever=Contriever, Reranker=Cross-Encoder, Reranker Category=Fine-tuned Transformer, LCR Enhancement=None2026.02 | 0.487 | 0.3172 | 0.1306 | 0.3659 | 0.4595 | 0.7846 | 0.4241 | |
| Cross-Encoder + LCR w/o QTRetriever=Contriever, Reranker=Cross-Encoder, LCR Enhancement=LCR, Query Threshold (QT)=false2026.02 | 0.4867 | 0.3172 | 0.1308 | 0.3659 | 0.4599 | 0.7846 | 0.4242 | |
| ColBERT + LCRRetriever=Contriever, Reranker=ColBERT, LCR Enhancement=LCR, Query Threshold (QT)=true2026.02 | 0.4808 | 0.3651 | 0.1254 | 0.3579 | 0.4376 | 0.7619 | 0.4214 | |
| ColBERTRetriever=Contriever, Reranker=ColBERT, Reranker Category=Fine-tuned Transformer, LCR Enhancement=None2026.02 | 0.4778 | 0.357 | 0.1247 | 0.3574 | 0.4376 | 0.7617 | 0.4194 | |
| ColBERT + LCR w/o QTRetriever=Contriever, Reranker=ColBERT, LCR Enhancement=LCR, Query Threshold (QT)=false2026.02 | 0.4775 | 0.357 | 0.1249 | 0.3574 | 0.4375 | 0.7619 | 0.4193 | |
| RankGPT + LCR w/o QTRetriever=Contriever, Reranker=RankGPT, LCR Enhancement=LCR, Query Threshold (QT)=false2026.02 | 0.4613 | 0.2675 | 0.1185 | 0.3569 | 0.4295 | 0.7432 | 0.3962 | |
| RankGPT + LCRRetriever=Contriever, Reranker=RankGPT, LCR Enhancement=LCR, Query Threshold (QT)=true2026.02 | 0.4613 | 0.2804 | 0.1195 | 0.3579 | 0.4366 | 0.7432 | 0.3998 | |
| Contriever + LCR w/o QTRetriever=Contriever, Reranker=None, LCR Enhancement=LCR, Query Threshold (QT)=false2026.02 | 0.4607 | 0.2675 | 0.1185 | 0.358 | 0.4294 | 0.7431 | 0.3962 | |
| Contriever + LCRRetriever=Contriever, Reranker=None, LCR Enhancement=LCR, Query Threshold (QT)=true2026.02 | 0.4607 | 0.2804 | 0.1195 | 0.3589 | 0.4364 | 0.7431 | 0.3998 | |
| RankGPTRetriever=Contriever, Reranker=RankGPT, Reranker Category=Pre-trained LLM, LCR Enhancement=None2026.02 | 0.4563 | 0.2612 | 0.118 | 0.3569 | 0.4286 | 0.7427 | 0.3939 | |
| ContrieverRetriever=Contriever, Reranker=None, LCR Enhancement=None2026.02 | 0.4554 | 0.2612 | 0.118 | 0.358 | 0.4285 | 0.7425 | 0.3939 | |
| QLM + LCR w/o QTRetriever=Contriever, Reranker=QLM, LCR Enhancement=LCR, Query Threshold (QT)=false2026.02 | 0.3985 | 0.2599 | 0.1224 | 0.3143 | 0.3708 | 0.5871 | 0.3422 | |
| QLM + LCRRetriever=Contriever, Reranker=QLM, LCR Enhancement=LCR, Query Threshold (QT)=true2026.02 | 0.3985 | 0.2599 | 0.1224 | 0.3153 | 0.3708 | 0.5871 | 0.3423 | |
| YesNo + LCR w/o QTRetriever=Contriever, Reranker=YesNo, LCR Enhancement=LCR, Query Threshold (QT)=false2026.02 | 0.3515 | 0.2577 | 0.0937 | 0.2882 | 0.3512 | 0.4689 | 0.3019 | |
| YesNo + LCRRetriever=Contriever, Reranker=YesNo, LCR Enhancement=LCR, Query Threshold (QT)=true2026.02 | 0.3515 | 0.259 | 0.0937 | 0.2882 | 0.3512 | 0.4689 | 0.3021 | |
| QLMRetriever=Contriever, Reranker=QLM, Reranker Category=Pre-trained LLM, LCR Enhancement=None2026.02 | 0.3486 | 0.2269 | 0.1218 | 0.3143 | 0.3314 | 0.5569 | 0.3166 | |
| YesNoRetriever=Contriever, Reranker=YesNo, Reranker Category=Pre-trained LLM, LCR Enhancement=None2026.02 | 0.2312 | 0.2476 | 0.0778 | 0.2645 | 0.2928 | 0.2546 | 0.2281 | |
| RankT5 + LCRReranker Type=Fine-tuned Transformer Based, LCR Enhancement=true, Base Retriever=BM252026.02 | 0.0839 | 0.5322 | 0.1378 | 0.4049 | 0.1482 | 0.4864 | 0.2989 | |
| RankT5Reranker Type=Fine-tuned Transformer Based, LCR Enhancement=false, Base Retriever=BM252026.02 | 0.0831 | 0.5165 | 0.1376 | 0.4041 | 0.1479 | 0.4864 | 0.2959 | |
| Cross-Encoder + LCRReranker Type=Fine-tuned Transformer Based, LCR Enhancement=true, Base Retriever=BM252026.02 | 0.0817 | 0.4972 | 0.1266 | 0.3936 | 0.1467 | 0.4779 | 0.2873 | |
| Cross-EncoderReranker Type=Fine-tuned Transformer Based, LCR Enhancement=false, Base Retriever=BM252026.02 | 0.0812 | 0.4664 | 0.1266 | 0.3921 | 0.1465 | 0.4779 | 0.2818 | |
| ColBERT + LCRReranker Type=Fine-tuned Transformer Based, LCR Enhancement=true, Base Retriever=BM252026.02 | 0.0805 | 0.4936 | 0.1205 | 0.3839 | 0.1413 | 0.4745 | 0.2824 | |
| ColBERTReranker Type=Fine-tuned Transformer Based, LCR Enhancement=false, Base Retriever=BM252026.02 | 0.0791 | 0.4778 | 0.1204 | 0.3832 | 0.141 | 0.4745 | 0.2793 | |
| QLM + LCRReranker Type=Pre-trained LLM Based, LCR Enhancement=true, Base Retriever=BM252026.02 | 0.063 | 0.4456 | 0.1228 | 0.3427 | 0.1037 | 0.3608 | 0.2397 | |
| QLMReranker Type=Pre-trained LLM Based, LCR Enhancement=false, Base Retriever=BM252026.02 | 0.061 | 0.409 | 0.1215 | 0.3415 | 0.1003 | 0.3595 | 0.2321 | |
| RankGPT + LCRReranker Type=Pre-trained LLM Based, LCR Enhancement=true, Base Retriever=BM252026.02 | 0.0587 | 0.5018 | 0.1149 | 0.3649 | 0.1078 | 0.3295 | 0.2463 | |
| BM25 + LCRReranker Type=Retriever-Only, LCR Enhancement=true, Base Retriever=BM252026.02 | 0.0585 | 0.5015 | 0.1149 | 0.3659 | 0.1078 | 0.3294 | 0.2463 | |
| YesNo + LCRReranker Type=Pre-trained LLM Based, LCR Enhancement=true, Base Retriever=BM252026.02 | 0.0516 | 0.46 | 0.0872 | 0.3087 | 0.0912 | 0.2581 | 0.2095 | |
| RankGPTReranker Type=Pre-trained LLM Based, LCR Enhancement=false, Base Retriever=BM252026.02 | 0.0489 | 0.4914 | 0.1144 | 0.363 | 0.1058 | 0.3111 | 0.2391 | |
| BM25Reranker Type=Retriever-Only, LCR Enhancement=false, Base Retriever=BM252026.02 | 0.0488 | 0.4911 | 0.1144 | 0.364 | 0.1059 | 0.3111 | 0.2392 | |
| YesNoReranker Type=Pre-trained LLM Based, LCR Enhancement=false, Base Retriever=BM252026.02 | 0.0321 | 0.4388 | 0.0685 | 0.2941 | 0.0777 | 0.131 | 0.1737 |