Information Retrieval on TREC DL 2020 (test)
0.8012NDCG@10TCT-ColBERT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| TCT-ColBERTTask=Indexing2023.05 | 0.8012 | 0.6315 | — | — | |
| DSI-QG-MultiTask=Retrieval2023.05 | 0.7983 | 0.6278 | — | — | |
| DSI-QG-D+MTask=Retrieval2023.05 | 0.7851 | 0.6074 | — | — | |
| DSI-QG-DistillTask=Indexing2023.05 | 0.7801 | 0.6056 | — | — | |
| DSI-QG-MergeTask=Indexing2023.05 | 0.7501 | 0.5815 | — | — | |
| DSI-QGTask=Indexing2023.05 | 0.7348 | 0.563 | — | — | |
| NCITask=Indexing2023.05 | 0.7127 | 0.5407 | — | — | |
| Mohajer + Bu.LLM=Flan-T5-XXL2026.05 | 0.6896 | — | — | 344.17 | |
| BM25Task=Indexing2023.05 | 0.6873 | 0.4852 | — | — | |
| Two-LLM QE (Concat)Retriever=SBERT, Expansion=Two-LLM Ensemble (Concat)2026.02 | 0.6859 | 0.7074 | 51.45 | — | |
| Two-LLM QE (Refine)Retriever=SBERT, Expansion=Two-LLM Ensemble (Refine)2026.02 | 0.6832 | 0.7167 | 52.29 | — | |
| Mohajer + Bu.LLM=Flan-T5-XL2026.05 | 0.663 | — | — | 338.74 | |
| PRP-Graph-10LLM=Flan-T5-XL2026.05 | 0.661 | — | — | 492.5 | |
| PRP-Graph-10LLM=Flan-T5-XXL2026.05 | 0.661 | — | — | 492.6 | |
| Cluster-ICL QERetriever=SBERT, Expansion=Cluster-ICL2026.02 | 0.6584 | 0.6833 | 49.39 | — | |
| SBERTRetriever=SBERT, Expansion=None2026.02 | 0.6344 | 0.6833 | 50.89 | — | |
| FewShot4-FixedRetriever=SBERT, Expansion=Few-shot (4 fixed)2026.02 | 0.6279 | 0.6537 | 48.37 | — | |
| PRP-Graph-10LLM=Flan-T5-L2026.05 | 0.618 | — | — | 492.5 | |
| PAC + Bu.LLM=Flan-T5-XXL2026.05 | 0.6071 | — | — | 183.59 | |
| Mohajer + Bu.LLM=Flan-T5-L2026.05 | 0.588 | — | — | 354.245 | |
| PAC + Bu.LLM=Flan-T5-XL2026.05 | 0.5851 | — | — | 183.72 | |
| PAC + Bu.LLM=Flan-T5-L2026.05 | 0.5729 | — | — | 183.99 | |
| ZeroShotRetriever=SBERT, Expansion=Zero-shot2026.02 | 0.5689 | 0.5852 | 46.15 | — | |
| BM25LLM=NA2026.05 | 0.48 | — | — | — | |
| DSITask=Indexing2023.05 | 0.1907 | 0.1167 | — | — |