Conversational Search on QReCC (test)
57.4MRRMSPA-CQR
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MSPA-CQRRetrieval Type=Sparse (BM25), Backbone=LLaMA2-7B, Feedback Setting=w/ Rewriting, Retrieval and Response Feedback2026.04 | 57.4 | 54.1 | 77.6 | 95.2 | |
| AdaCQRRetrieval Type=Sparse (BM25), Backbone=T5-base, Feedback Setting=w/ Retrieval Feedback2026.04 | 55.1 | 52.5 | 76.5 | 93.7 | |
| CHIQRetrieval Type=Sparse (BM25), Backbone=LLaMA2-7B, Feedback Setting=w/o Feedback2026.04 | 54.3 | 51.9 | 78.5 | — | |
| LLM4CSRetrieval Type=Sparse (BM25), Backbone=ChatGPT, Feedback Setting=w/o Feedback2026.04 | 51.6 | 49.3 | 75.3 | 92.6 | |
| RETPORetrieval Type=Sparse (BM25), Backbone=LLaMA2-7B, Feedback Setting=w/ Retrieval Feedback2026.04 | 50 | 47.3 | 69.5 | 89.5 | |
| LLM-AidedRetrieval Type=Sparse (BM25), Backbone=ChatGPT, Feedback Setting=w/o Feedback2026.04 | 49.4 | 46.5 | 67.1 | 88.2 | |
| MSPA-CQRRetrieval Type=Dense (ANCE), Backbone=LLaMA2-7B, Feedback Setting=w/ Rewriting, Retrieval and Response Feedback2026.04 | 48.7 | 45.7 | 72.3 | 87.5 | |
| CHIQRetrieval Type=Dense (ANCE), Backbone=LLaMA2-7B, Feedback Setting=w/o Feedback2026.04 | 47.2 | 44.6 | 70.8 | — | |
| IterCQRRetrieval Type=Sparse (BM25), Backbone=T5-base, Feedback Setting=w/ Retrieval Feedback2026.04 | 46.7 | 44.1 | 64.4 | 85.5 | |
| AdaCQRRetrieval Type=Dense (ANCE), Backbone=T5-base, Feedback Setting=w/ Retrieval Feedback2026.04 | 45.8 | 42.9 | 67.3 | 83.8 | |
| LLM4CSRetrieval Type=Dense (ANCE), Backbone=ChatGPT, Feedback Setting=w/o Feedback2026.04 | 44.7 | 41.8 | 67.2 | 84 | |
| RETPORetrieval Type=Dense (ANCE), Backbone=LLaMA2-7B, Feedback Setting=w/ Retrieval Feedback2026.04 | 44 | 41.1 | 66.7 | 84.6 | |
| LLM-AidedRetrieval Type=Dense (ANCE), Backbone=ChatGPT, Feedback Setting=w/o Feedback2026.04 | 43.5 | 41.3 | 65.6 | 82.3 | |
| IterCQRRetrieval Type=Dense (ANCE), Backbone=T5-base, Feedback Setting=w/ Retrieval Feedback2026.04 | 42.9 | 40.2 | 65.5 | 84.1 | |
| EDIRCSRetrieval Type=Dense (ANCE), Backbone=T5-base, Feedback Setting=w/o Feedback2026.04 | 42.1 | — | 65.6 | 85.3 | |
| EDIRCSRetrieval Type=Sparse (BM25), Backbone=T5-base, Feedback Setting=w/o Feedback2026.04 | 41.2 | — | 62.7 | 90.2 |