Information Retrieval on ToT Retrieval Mistral Rewritten Queries (test)
0.3706nDCG@10Qwen 2.5 72B Instruct (4-bit)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Qwen 2.5 72B Instruct (4-bit)Pipeline Stage=List-wise LLM Re-ranking (Stage 4), Query Formulation=Mistral Rewritten, Precision=4-bit, Zero-shot=true2026.02 | 0.3706 | 0.3482 | 0.455 | 0.3438 | 19.16 | |
| MonoT5Pipeline Stage=Cross-Encoder Re-ranking (Stage 3), Query Formulation=Mistral Rewritten, Zero-shot=true2026.02 | 0.311 | 0.2822 | 0.4244 | 0.2757 | 33.04 | |
| Dense Fusion (RRF)Pipeline Stage=Bi-encoder Re-ranking (Stage 2), Query Formulation=Mistral Rewritten, Zero-shot=true2026.02 | 0.2338 | 0.2081 | 0.3457 | 0.1987 | 34.48 | |
| E5-Large-v2Pipeline Stage=Bi-encoder Re-ranking (Stage 2), Query Formulation=Mistral Rewritten, Zero-shot=true2026.02 | 0.2253 | 0.1989 | 0.3376 | 0.1905 | 29.59 | |
| BM25Pipeline Stage=Sparse Retrieval (Stage 1), Query Formulation=Mistral Rewritten, Zero-shot=true2026.02 | 0.1738 | 0.1586 | 0.2476 | 0.1515 | 0 | |
| ContrieverPipeline Stage=Bi-encoder Re-ranking (Stage 2), Query Formulation=Mistral Rewritten, Zero-shot=true2026.02 | 0.1458 | 0.1283 | 0.2331 | 0.1188 | -16.15 | |
| ColBERTv2Pipeline Stage=Bi-encoder Re-ranking (Stage 2), Query Formulation=Mistral Rewritten, Zero-shot=true2026.02 | 0.1361 | 0.1256 | 0.1961 | 0.1176 | -21.73 |