Information Retrieval on ToT Retrieval Mistral Rewritten Queries 1.0 (test)
37.06nDCG@10Qwen 2.5 72B Instruct (4-bit)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Qwen 2.5 72B Instruct (4-bit)Pipeline Stage=List-wise LLM Re-ranking (Stage 4), Query Reformulation=Mistral Rewritten, Zero-shot=true2026.02 | 37.06 | 34.82 | 45.5 | 34.38 | 19.16 | |
| MonoT5Pipeline Stage=Cross-Encoder Re-ranking (Stage 3), Query Reformulation=Mistral Rewritten, Zero-shot=true2026.02 | 31.1 | 28.22 | 42.44 | 27.57 | 33.04 | |
| Dense Fusion (RRF)Pipeline Stage=Bi-encoder Re-ranking (Stage 2), Query Reformulation=Mistral Rewritten, Zero-shot=true2026.02 | 23.38 | 20.81 | 34.57 | 19.87 | 34.48 | |
| E5-Large-v2Pipeline Stage=Bi-encoder Re-ranking (Stage 2), Query Reformulation=Mistral Rewritten, Zero-shot=true2026.02 | 22.53 | 19.89 | 33.76 | 19.05 | 29.59 | |
| BM25Pipeline Stage=Sparse Retrieval (Stage 1), Query Reformulation=Mistral Rewritten, Zero-shot=true2026.02 | 17.38 | 15.86 | 24.76 | 15.15 | 0 | |
| ContrieverPipeline Stage=Bi-encoder Re-ranking (Stage 2), Query Reformulation=Mistral Rewritten, Zero-shot=true2026.02 | 14.58 | 12.83 | 23.31 | 11.88 | -16.15 | |
| ColBERTv2Pipeline Stage=Bi-encoder Re-ranking (Stage 2), Query Reformulation=Mistral Rewritten, Zero-shot=true2026.02 | 13.61 | 12.56 | 19.61 | 11.76 | -21.73 |