Information Retrieval on TREC DL21
0.538nDCG@50QA-Expand + ReformIR
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| QA-Expand + ReformIR2026.05 | 0.538 | — | — | — | 0.356 | 0.523 | 0.463 | |
| Query2Doc + ReformIR2026.05 | 0.531 | — | — | — | 0.354 | 0.533 | 0.481 | |
| QA-Expand + RRF [F]2026.05 | 0.498 | — | — | — | 0.328 | 0.493 | 0.441 | |
| GEns + PRF + ReformIR2026.05 | 0.491 | — | — | — | 0.315 | 0.485 | 0.409 | |
| QA-Expand (Q)2026.05 | 0.483 | — | — | — | 0.329 | 0.482 | 0.437 | |
| GenQR + ReformIR2026.05 | 0.482 | — | — | — | 0.299 | 0.488 | 0.403 | |
| GEns + ReformIR2026.05 | 0.48 | — | — | — | 0.308 | 0.484 | 0.402 | |
| Query2Doc (QD)2026.05 | 0.456 | — | — | — | 0.316 | 0.466 | 0.42 | |
| BM25»MonoT5 + RM32026.05 | 0.455 | — | — | — | 0.274 | 0.457 | 0.375 | |
| BM25»MonoT5 [B]2026.05 | 0.436 | — | — | — | 0.242 | 0.433 | 0.331 | |
| GEns (GE)2026.05 | 0.421 | — | — | — | 0.266 | 0.432 | 0.37 | |
| GEns + PRF [R]2026.05 | 0.408 | — | — | — | 0.251 | 0.41 | 0.332 | |
| GenQR + RRF [F]2026.05 | 0.39 | — | — | — | 0.226 | 0.407 | 0.324 | |
| GEns + RRF [F]2026.05 | 0.39 | — | — | — | 0.232 | 0.424 | 0.35 | |
| GenQR (G)2026.05 | 0.382 | — | — | — | 0.224 | 0.398 | 0.318 | |
| BM25 (no expansion)Retriever=BM25 Retriever (DeepSeek Distillation)2026.03 | — | 44.58 | 17.08 | 50.6 | — | — | — | |
| BM25+RocchioRetriever=BM25 Retriever (DeepSeek Distillation)2026.03 | — | 45.44 | 21.51 | 54.42 | — | — | — | |
| DPO-onlyRetriever=BM25 Retriever (DeepSeek Distillation)2026.03 | — | 55.6 | 26.45 | 67.68 | — | — | — | |
| Original model expansionRetriever=BM25 Retriever (DeepSeek Distillation)2026.03 | — | 51.86 | 25.43 | 66.59 | — | — | — | |
| Query2DocRetriever=BM25 Retriever (DeepSeek Distillation)2026.03 | — | 50.01 | 24.07 | 66.25 | — | — | — | |
| SFT-onlyRetriever=BM25 Retriever (DeepSeek Distillation)2026.03 | — | 52.71 | 26.22 | 65.89 | — | — | — | |
| SFT+DPORetriever=BM25 Retriever (DeepSeek Distillation)2026.03 | — | 56.33 | 27.89 | 68.49 | — | — | — |