Document Reranking on SCID
13.919NDCG@5RankT5 + CAR
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| RankT5 + CARRetriever=Contriever, Category=Supervised Neural Reranker, Confidence-Aware Reranking=Enabled2026.05 | 13.919 | 0 | |
| RankT5Retriever=Contriever, Category=Supervised Neural Reranker2026.05 | 13.913 | — | |
| Cross-Encoder + CARRetriever=Contriever, Category=Supervised Neural Reranker, Confidence-Aware Reranking=Enabled2026.05 | 13.066 | 0 | |
| Cross-EncoderRetriever=Contriever, Category=Supervised Neural Reranker2026.05 | 13.063 | — | |
| ColBERT + CARRetriever=Contriever, Category=Supervised Neural Reranker, Confidence-Aware Reranking=Enabled2026.05 | 12.486 | 0.1 | |
| ColBERTRetriever=Contriever, Category=Supervised Neural Reranker2026.05 | 12.468 | — | |
| QLM + CARLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker, Confidence-Aware Reranking=Enabled2026.05 | 12.216 | 0.3 | |
| QLMLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker2026.05 | 12.177 | — | |
| Contriever + CARRetriever=Contriever, Category=Retriever Only, Confidence-Aware Reranking=Enabled2026.05 | 11.857 | 0.5 | |
| RankGPT + CARLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker, Confidence-Aware Reranking=Enabled2026.05 | 11.857 | 0.5 | |
| ContrieverRetriever=Contriever, Category=Retriever Only2026.05 | 11.8 | — | |
| RankGPTLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker2026.05 | 11.8 | — | |
| YesNo + CARLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker, Confidence-Aware Reranking=Enabled2026.05 | 8.91 | 14.5 | |
| YesNoLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker2026.05 | 7.781 | — |