Conversational Retrieval on QReCC (test)
75.8Recall@10ChatRetriever
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ChatRetrieverCategory=CDR, Architecture=LLM-based Decoder-only Dense Retriever (7B)2025.07 | 75.8 | 52.5 | — | — | |
| QRACDRCategory=CDR, Architecture=SLM-based Encoder-only Dense Retriever (110M)2025.07 | 74.8 | 49.1 | — | — | |
| HAConvDRCategory=CDR2024.01 | 72.4 | 45.6 | 48.5 | 88.9 | |
| Conv-ANCECategory=CDR, Architecture=SLM-based Encoder-only Dense Retriever (110M)2025.07 | 71.5 | 45.6 | — | — | |
| Conv-ANCECategory=CDR2024.01 | 71.5 | 45.6 | 47.1 | 87.2 | |
| CHIQCategory=CQR, Architecture=LLM-based Conversational Query Rewriter (7B) + Ad-hoc Dense Retriever (110M)2025.07 | 70.8 | 44.6 | — | — | |
| SDRConvCategory=CDR2024.01 | 69.8 | 43.6 | 47.3 | 88.4 | |
| Conv-GRITCategory=CDR, Architecture=LLM-based Decoder-only Dense Retriever (7B)2025.07 | 69.7 | 48.3 | — | — | |
| UniConvCategory=CDR, Architecture=LLM-based Decoder-only Dense Retriever (7B)2025.07 | 68.9 | 47.6 | — | — | |
| RETPOCategory=CQR, Architecture=LLM-based Conversational Query Rewriter (7B) + Ad-hoc Dense Retriever (110M), Configuration=fine-tuned2025.07 | 66.7 | 41.1 | — | — | |
| InstructoRCategory=CDR2024.01 | 66.7 | 40.5 | 43.5 | 85.6 | |
| LLM4CSCategory=CQR, Architecture=LLM-based Conversational Query Rewriter (7B) + Ad-hoc Dense Retriever (110M)2025.07 | 66.4 | 42.1 | — | — | |
| LLM AidedCategory=CQR, Architecture=LLM-based Conversational Query Rewriter (7B) + Ad-hoc Dense Retriever (110M)2025.07 | 65.6 | 41.3 | — | — | |
| LLM-Aided IQRCategory=CQR2024.01 | 65.6 | 41.3 | 43.9 | 79.6 | |
| IterCQRCategory=CQR2024.01 | 65.5 | 40.2 | 42.9 | 84.1 | |
| CONQRRRetrieval Type=Dense2023.05 | 65.1 | — | 41.8 | 84.7 | |
| CONQRRCategory=CQR2024.01 | 65.1 | — | 41.8 | 84.7 | |
| ConvGQRRetrieval Type=Sparse2023.05 | 64.4 | 41 | 44.1 | 88 | |
| ConvGQRRetrieval Type=Dense2023.05 | 63.5 | 39.1 | 42 | 81.8 | |
| ConvGQRCategory=CQR2024.01 | 63.5 | 39.1 | 42 | 81.8 | |
| Human-RewrittenRetrieval Type=Sparse2023.05 | 62.5 | 36.2 | 39.7 | 98.5 | |
| CONQRRRetrieval Type=Sparse2023.05 | 60.1 | — | 38.3 | 88.9 | |
| Human-RewrittenRetrieval Type=Dense2023.05 | 58.6 | 35.6 | 38.4 | 78.1 | |
| ConvDRCategory=CDR, Architecture=SLM-based Encoder-only Dense Retriever (110M)2025.07 | 58.2 | 35.7 | — | — | |
| ConvDRRetrieval Type=Dense2023.05 | 58.2 | 35.7 | 38.5 | 77.8 | |
| ConvDRCategory=CDR2024.01 | 58.2 | 35.7 | 38.5 | 77.8 | |
| QuReTeCRetrieval Type=Sparse2023.05 | 55.5 | 30.5 | 34 | 86 | |
| QuReTeCRetrieval Type=Dense2023.05 | 55 | 32.6 | 35 | 72.9 | |
| QuReTeCCategory=CQR2024.01 | 55 | 32.6 | 35 | 72.9 | |
| T5QRRetrieval Type=Sparse2023.05 | 53.8 | 30.2 | 33.4 | 86.1 | |
| GPT2QRRetrieval Type=Dense2023.05 | 53.1 | 30.9 | 33.9 | 72.9 | |
| T5QRRetrieval Type=Dense2023.05 | 53.1 | 31.8 | 34.5 | 72.8 | |
| GPT2+WSCategory=CQR2024.01 | 53.1 | 30.9 | 33.9 | 72.9 | |
| T5QRCategory=CQR2024.01 | 53.1 | 31.8 | 34.5 | 72.8 | |
| CQE-sparseRetrieval Type=Sparse2023.05 | 52.9 | 29.2 | 31.8 | 83.4 | |
| CQE-sparseRetrieval Type=Dense2023.05 | 51.3 | 30.1 | 32 | 70.9 | |
| CQE-sparseCategory=CQR2024.01 | 51.3 | 30.1 | 32 | 70.9 | |
| GPT2QRRetrieval Type=Sparse2023.05 | 50.5 | 27.9 | 30.4 | 82.3 | |
| GRITCategory=CDR, Architecture=LLM-based Decoder-only Dense Retriever (7B)2025.07 | 23.6 | 33.5 | — | — | |
| E5Category=CDR, Architecture=LLM-based Decoder-only Dense Retriever (7B)2025.07 | 21.1 | 32.9 | — | — | |
| RepLLaMACategory=CDR, Architecture=LLM-based Decoder-only Dense Retriever (7B)2025.07 | 20.4 | 31.8 | — | — | |
| RawRetrieval Type=Dense2023.05 | 15.7 | 9.3 | 10.2 | 22.7 | |
| RawRetrieval Type=Sparse2023.05 | 11.1 | 5.5 | 6.5 | 21.5 |