Factoid-style Retrieval on TREC DL19
68.8NDCG@10ThinkQE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ThinkQEEvaluation Protocol=Zero-shot Query expansion with BM25, Backbone Model=R1-14B2025.06 | 68.8 | 45.9 | 89.3 | |
| Rank-K-32BMethod Type=R1-Distilled Reranker, Evaluation Protocol=BM25 Top-20 Docs2025.06 | 66.2 | — | — | |
| Query2docMethod Type=Zero-shot Query expansion, Evaluation Protocol=with BM252025.06 | 66.2 | — | — | |
| ThinkQEEvaluation Protocol=Zero-shot Query expansion with BM25, Backbone Model=OpenThinker2-7B2025.06 | 65.3 | 44.8 | 87.3 | |
| ThinkQEEvaluation Protocol=Zero-shot Query expansion with BM25, Backbone Model=QWEN3-8B2025.06 | 65 | 44.5 | 87.9 | |
| ThinkQEEvaluation Protocol=Zero-shot Query expansion with BM25, Backbone Model=Phi4-Reasoning-14B2025.06 | 65 | 44 | 87.1 | |
| Rank1-32BMethod Type=R1-Distilled Reranker, Evaluation Protocol=BM25 Top-20 Docs2025.06 | 64.9 | — | — | |
| LameRMethod Type=Zero-shot Query expansion, Evaluation Protocol=with BM252025.06 | 64.9 | 42.8 | 84.2 | |
| ThinkQEEvaluation Protocol=Zero-shot Query expansion with BM25, Backbone Model=QWEN3-14B2025.06 | 64.9 | 45.2 | 88.4 | |
| ANCEMethod Type=Supervised Fine-Tuned Dense retriever2025.06 | 64.5 | 37.1 | 75.5 | |
| MILLMethod Type=Zero-shot Query expansion, Evaluation Protocol=with BM252025.06 | 63.8 | — | 85.9 | |
| CSQEMethod Type=Zero-shot Query expansion, Evaluation Protocol=with BM252025.06 | 63.4 | 43.6 | 87.6 | |
| DPRMethod Type=Supervised Fine-Tuned Dense retriever2025.06 | 62.2 | 36.5 | 76.9 | |
| ContrieverFTMethod Type=Supervised Fine-Tuned Dense retriever2025.06 | 62.1 | 41.7 | 83.6 | |
| HyDEMethod Type=Zero-shot Query expansion, Evaluation Protocol=with BM252025.06 | 61.3 | 41.8 | 88 | |
| BM25Method Type=Keyword Retrieval2025.06 | 50.6 | 30.1 | 75 |