Information Retrieval on ToT Retrieval Original Queries 1.0 (test)
27.68nDCG@10Qwen 2.5 72B Instruct (4-bit)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Qwen 2.5 72B Instruct (4-bit)Pipeline Stage=List-wise LLM Re-ranking (Stage 4), Zero-shot=true2026.02 | 27.68 | 26.8 | 41.8 | 26.45 | 50.51 | |
| MonoT5Pipeline Stage=Cross-Encoder Re-ranking (Stage 3), Zero-shot=true2026.02 | 18.39 | 16.37 | 41.64 | 15.77 | 16.46 | |
| E5-Large-v2Pipeline Stage=Bi-encoder Re-ranking (Stage 2), Zero-shot=true2026.02 | 18.37 | 16.6 | 42.28 | 15.96 | 59.18 | |
| Dense Fusion (RRF)Pipeline Stage=Bi-encoder Re-ranking (Stage 2), Zero-shot=true2026.02 | 15.79 | 13.94 | 40.68 | 13.25 | 36.82 | |
| BM25Pipeline Stage=Sparse Retrieval (Stage 1), Zero-shot=true2026.02 | 12.23 | 11.14 | 30.39 | 10.64 | 0 | |
| BM25 + KLPipeline Stage=Sparse Retrieval (Stage 1), Zero-shot=true2026.02 | 11.54 | 10.3 | 31.35 | 9.74 | -5.64 | |
| BM25 + Bo1Pipeline Stage=Sparse Retrieval (Stage 1), Zero-shot=true2026.02 | 11.36 | 10.02 | 31.03 | 9.5 | -7.11 | |
| BM25 + RM3Pipeline Stage=Sparse Retrieval (Stage 1), Zero-shot=true2026.02 | 10.33 | 9.78 | 23.63 | 9.39 | -15.53 | |
| ContrieverPipeline Stage=Bi-encoder Re-ranking (Stage 2), Zero-shot=true2026.02 | 10.21 | 8.96 | 33.12 | 8.32 | -11.52 | |
| ColBERTv2Pipeline Stage=Bi-encoder Re-ranking (Stage 2), Zero-shot=true2026.02 | 7.23 | 6.54 | 28.78 | 5.88 | -37.34 |