Document Reranking on AVG
54.373NDCG@5RankT5 + CAR
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| RankT5 + CARRetriever=Contriever, Category=Supervised Neural Reranker, Confidence-Aware Reranking=Enabled2026.05 | 54.373 | 0.1 | |
| RankT5Retriever=Contriever, Category=Supervised Neural Reranker2026.05 | 54.33 | — | |
| Cross-Encoder + CARRetriever=Contriever, Category=Supervised Neural Reranker, Confidence-Aware Reranking=Enabled2026.05 | 52.286 | 0.1 | |
| Cross-EncoderRetriever=Contriever, Category=Supervised Neural Reranker2026.05 | 52.253 | — | |
| ColBERT + CARRetriever=Contriever, Category=Supervised Neural Reranker, Confidence-Aware Reranking=Enabled2026.05 | 51.642 | 0.2 | |
| ColBERTRetriever=Contriever, Category=Supervised Neural Reranker2026.05 | 51.529 | — | |
| RankGPT + CARLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker, Confidence-Aware Reranking=Enabled2026.05 | 49.127 | 1.9 | |
| Contriever + CARRetriever=Contriever, Category=Retriever Only, Confidence-Aware Reranking=Enabled2026.05 | 49.042 | 1.8 | |
| RankGPTLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker2026.05 | 48.225 | — | |
| ContrieverRetriever=Contriever, Category=Retriever Only2026.05 | 48.167 | — | |
| QLM + CARLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker, Confidence-Aware Reranking=Enabled2026.05 | 43.65 | 3.9 | |
| QLMLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker2026.05 | 42.032 | — | |
| YesNo + CARLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker, Confidence-Aware Reranking=Enabled2026.05 | 35.093 | 25.4 | |
| YesNoLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker2026.05 | 27.996 | — |