Conversational Search Retrieval on TopiOCQA (test)
30.1MRRHAConvDR
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| HAConvDRCategory=CDR2024.01 | 30.1 | 28.5 | 50.8 | 72.8 | |
| ConvDRCategory=CDR2024.01 | 27.2 | 26.4 | 43.5 | 61.1 | |
| IterCQRCategory=CQR2024.01 | 26.3 | 25.1 | 42.6 | 62 | |
| SDRConvCategory=CDR2024.01 | 26.1 | 25.4 | 44.4 | 63.2 | |
| ConvGQRRetrieval Type=Dense2023.05 | 25.6 | 24.3 | 41.8 | 58.8 | |
| ConvGQRCategory=CQR2024.01 | 25.6 | 24.3 | 41.8 | 58.8 | |
| InstructoRCategory=CDR2024.01 | 25.3 | 23.7 | 45.1 | 69 | |
| T5QRCategory=CQR2024.01 | 23.4 | 22.5 | 39.8 | 56.2 | |
| T5QRRetrieval Type=Dense2023.05 | 23 | 22.2 | 37.6 | 54.4 | |
| Conv-ANCECategory=CDR2024.01 | 22.9 | 20.5 | 43 | 71 | |
| CQE-sparseCategory=CQR2024.01 | 14.3 | 13.6 | 24.8 | 36.7 | |
| GPT2QRRetrieval Type=Dense2023.05 | 12.6 | 12 | 22 | 33.1 | |
| GPT2+WSCategory=CQR2024.01 | 12.6 | 12 | 22 | 33.1 | |
| ConvGQRRetrieval Type=Sparse2023.05 | 12.4 | 10.7 | 23.8 | 45.6 | |
| T5QRRetrieval Type=Sparse2023.05 | 11.3 | 9.8 | 22.1 | 44.7 | |
| QuReTeCRetrieval Type=Dense2023.05 | 11.2 | 10.5 | 20.2 | 34.4 | |
| QuReTeCCategory=CQR2024.01 | 11.2 | 10.5 | 20.2 | 34.3 | |
| QuReTeCRetrieval Type=Sparse2023.05 | 8.5 | 7.3 | 16 | 31.3 | |
| GPT2QRRetrieval Type=Sparse2023.05 | 6.2 | 5.3 | 12.4 | 26.4 | |
| RawRetrieval Type=Dense2023.05 | 4.1 | 3.8 | 7.5 | 13.8 | |
| RawRetrieval Type=Sparse2023.05 | 2.1 | 1.8 | 4 | 9.2 |