Conversational Search on CAsT 20
58.6MRRLLM4CS
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LLM4CSBackbone=ChatGPT-3.5, Zero-shot=true, Dense retrieval (ANCE)=true2026.04 | 58.6 | 41.5 | 19.3 | |
| MSPA-CQRBackbone=LLaMA2-7B, Zero-shot=true, Dense retrieval (ANCE)=true2026.04 | 58.5 | 43.5 | 19.9 | |
| AdaCQRBackbone=T5-base, Zero-shot=true, Dense retrieval (ANCE)=true2026.04 | 56.6 | — | 19.2 | |
| CHIQBackbone=LLaMA2-7B, Zero-shot=true, Dense retrieval (ANCE)=true2026.04 | 54 | 38 | 19.3 | |
| ConvDR-SSPSearch=Dense2023.07 | 52.6 | 36.5 | — | |
| COTED-SSPSearch=Dense2023.07 | 50.1 | 35.1 | — | |
| ConvDRSearch=Dense2023.07 | 50.1 | 34 | — | |
| ContQESearch=Dense2023.07 | 49.9 | 31.2 | — | |
| COTEDSearch=Dense2023.07 | 49.1 | 34.2 | — | |
| Query2docBackbone=ChatGPT-3.5, Zero-shot=true, Dense retrieval (ANCE)=true2026.04 | 48.6 | 32.5 | 17.3 | |
| COTED*Search=Dense, implementation=our implementation2023.07 | 48.1 | 32.1 | — | |
| HyDEBackbone=ChatGPT-3.5, Zero-shot=true, Dense retrieval (ANCE)=true2026.04 | 44.8 | 29.3 | 16.9 | |
| InstructorRBackbone=ChatGPT-3.5, Zero-shot=true, Dense retrieval (ANCE)=true2026.04 | 43.7 | 29.6 | 8.3 | |
| QuReTeCSearch=Dense2023.07 | 43 | 28.7 | — | |
| QueryRewriterSearch=Dense2023.07 | 37.5 | 25.5 | — | |
| Transformer++Search=Dense2023.07 | 29.6 | 18.5 | — | |
| RepLLaMABackbone=LLaMA2-7B, Zero-shot=true, Dense retrieval (ANCE)=true2026.04 | 26.8 | 18.3 | 10.4 | |
| QuReTeCSearch=Sparse2023.07 | 26.2 | 17.1 | — | |
| LLM-EmbedderBackbone=LLaMA2-7B, Zero-shot=true, Dense retrieval (ANCE)=true2026.04 | 25.2 | 15.4 | 8.7 | |
| QueryRewriterSearch=Sparse2023.07 | 25 | 15.9 | — | |
| RawSearch=Dense2023.07 | 23.4 | 15 | — | |
| E5-MistralBackbone=Mistral-7B, Zero-shot=true, Dense retrieval (ANCE)=true2026.04 | 22 | 15.4 | 8.4 | |
| Transformer++Search=Sparse2023.07 | 16.2 | 10 | — | |
| RawSearch=Sparse2023.07 | 16 | 10.1 | — |