Document Reranking on NQ
50.979NDCG@5RankT5 + CAR
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| RankT5 + CARRetriever=Contriever, Category=Supervised Neural Reranker, Confidence-Aware Reranking=Enabled2026.05 | 50.979 | 0 | |
| RankT5Retriever=Contriever, Category=Supervised Neural Reranker2026.05 | 50.969 | — | |
| Cross-EncoderRetriever=Contriever, Category=Supervised Neural Reranker2026.05 | 48.699 | — | |
| Cross-Encoder + CARRetriever=Contriever, Category=Supervised Neural Reranker, Confidence-Aware Reranking=Enabled2026.05 | 48.699 | 0 | |
| ColBERT + CARRetriever=Contriever, Category=Supervised Neural Reranker, Confidence-Aware Reranking=Enabled2026.05 | 47.809 | 0.1 | |
| ColBERTRetriever=Contriever, Category=Supervised Neural Reranker2026.05 | 47.779 | — | |
| RankGPT + CARLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker, Confidence-Aware Reranking=Enabled2026.05 | 45.752 | 0.3 | |
| Contriever + CARRetriever=Contriever, Category=Retriever Only, Confidence-Aware Reranking=Enabled2026.05 | 45.689 | 0.3 | |
| RankGPTLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker2026.05 | 45.63 | — | |
| ContrieverRetriever=Contriever, Category=Retriever Only2026.05 | 45.537 | — | |
| QLM + CARLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker, Confidence-Aware Reranking=Enabled2026.05 | 37.536 | 7.7 | |
| QLMLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker2026.05 | 34.862 | — | |
| YesNo + CARLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker, Confidence-Aware Reranking=Enabled2026.05 | 29.823 | 29 | |
| YesNoLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker2026.05 | 23.117 | — |