Document Reranking on NQ (test)
8.339NDCG@5RankT5
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| RankT5CAR=true, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 8.339 | 0.3 | |
| RankT5CAR=false, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 8.312 | — | |
| Cross-EncoderCAR=true, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 8.158 | 0.5 | |
| Cross-EncoderCAR=false, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 8.117 | — | |
| ColBERTCAR=true, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 7.994 | 1 | |
| ColBERTCAR=false, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 7.913 | — | |
| QLMCAR=true, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 6.292 | 3.1 | |
| QLMCAR=false, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 6.104 | — | |
| RankGPTCAR=true, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 5.486 | 12.2 | |
| BM25CAR=true, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 5.478 | 12.3 | |
| RankGPTCAR=false, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 4.888 | — | |
| BM25CAR=false, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 4.877 | — | |
| YesNoCAR=true, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 4.602 | 43.1 | |
| YesNoCAR=false, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 3.215 | — |