Conversational Search on TopiOCQA (test)
41.4MRRMSPA-CQR
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MSPA-CQRRetrieval Type=Dense (ANCE), Backbone=LLaMA2-7B, Feedback Setting=w/ Rewriting, Retrieval and Response Feedback2026.04 | 41.4 | 39.5 | 63.5 | 77.4 | |
| AdaCQRRetrieval Type=Dense (ANCE), Backbone=T5-base, Feedback Setting=w/ Retrieval Feedback2026.04 | 38.5 | 37.6 | 58.4 | 75 | |
| CHIQRetrieval Type=Dense (ANCE), Backbone=LLaMA2-7B, Feedback Setting=w/o Feedback2026.04 | 38 | 37 | 61.6 | — | |
| LLM4CSRetrieval Type=Dense (ANCE), Backbone=ChatGPT, Feedback Setting=w/o Feedback2026.04 | 35.4 | 34.4 | 55.2 | 72.2 | |
| MSPA-CQRRetrieval Type=Sparse (BM25), Backbone=LLaMA2-7B, Feedback Setting=w/ Rewriting, Retrieval and Response Feedback2026.04 | 30.6 | 29.5 | 51.9 | 75.2 | |
| RETPORetrieval Type=Dense (ANCE), Backbone=LLaMA2-7B, Feedback Setting=w/ Retrieval Feedback2026.04 | 30 | 28.9 | 49.6 | 68.7 | |
| AdaCQRRetrieval Type=Sparse (BM25), Backbone=T5-base, Feedback Setting=w/ Retrieval Feedback2026.04 | 28.3 | 26.5 | 48.9 | 71.2 | |
| RETPORetrieval Type=Sparse (BM25), Backbone=LLaMA2-7B, Feedback Setting=w/ Retrieval Feedback2026.04 | 28.3 | 26.5 | 48.3 | 73.1 | |
| LLM4CSRetrieval Type=Sparse (BM25), Backbone=ChatGPT, Feedback Setting=w/o Feedback2026.04 | 27.9 | 26.4 | 48.4 | 71.1 | |
| IterCQRRetrieval Type=Dense (ANCE), Backbone=T5-base, Feedback Setting=w/ Retrieval Feedback2026.04 | 26.3 | 25.1 | 42.6 | 62 | |
| CHIQRetrieval Type=Sparse (BM25), Backbone=LLaMA2-7B, Feedback Setting=w/o Feedback2026.04 | 25.6 | 23.5 | 44.7 | — | |
| IterCQRRetrieval Type=Sparse (BM25), Backbone=T5-base, Feedback Setting=w/ Retrieval Feedback2026.04 | 16.5 | 14.9 | 29.3 | 54.1 |