Conversational Question Answering on ConvMix 1.0 (test)
34.2P@1 (All)CONVINSE
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CONVINSEmode=Proposed2022.04 | 34.2 | 25.1 | 22 | 6.2 | 25.8 | 31.7 | 25.7 | 31 | 22 | 27.6 | 25.3 | |
| Prepend init+prevRetriever=BM25, Answering=FiD2022.04 | 31.2 | 23.4 | 23.3 | 7.4 | 27.6 | 29 | 23.8 | 29.2 | 22.9 | 27.4 | 27.2 | |
| Prepend allRetriever=BM25, Answering=FiD2022.04 | 30 | 23 | 23.4 | 7.4 | 28.2 | 29 | 23.8 | 28.2 | 22.4 | 26.7 | 26.5 | |
| Q. ResolutionRetriever=BM25, Answering=FiD2022.04 | 28.2 | 22.2 | 19 | 6.3 | 21.9 | 26.1 | 22.7 | 25.7 | 18.5 | 24.1 | 22.1 | |
| CONVINSEAnswer History Source=Predicted answers2022.04 | 27.8 | — | — | — | — | — | — | — | — | — | — | |
| Q. RewritingRetriever=BM25, Answering=FiD2022.04 | 27.1 | 21.6 | 18.3 | 6.2 | 21.9 | 25.2 | 22.1 | 26.1 | 18.7 | 22.7 | 22.3 | |
| Prepend prevRetriever=BM25, Answering=FiD2022.04 | 25.7 | 17.9 | 19 | 5.2 | 21.2 | 23.8 | 18.4 | 23.3 | 18.5 | 22.4 | 21.1 | |
| Prepend initRetriever=BM25, Answering=FiD2022.04 | 25.4 | 21.1 | 17.4 | 6.5 | 20 | 24.6 | 21.1 | 24 | 17.4 | 20.3 | 19.5 | |
| Prepend init+prevRetriever=BM25, Reader=FiD, Answer History Source=Predicted answers2022.04 | 24.3 | — | — | — | — | — | — | — | — | — | — | |
| Q. ResolutionRetriever=BM25, Reader=FiD, Answer History Source=Predicted answers2022.04 | 24.3 | — | — | — | — | — | — | — | — | — | — | |
| Prepend allRetriever=BM25, Reader=FiD, Answer History Source=Predicted answers2022.04 | 23.6 | — | — | — | — | — | — | — | — | — | — | |
| Prepend initRetriever=BM25, Reader=FiD, Answer History Source=Predicted answers2022.04 | 23.5 | — | — | — | — | — | — | — | — | — | — | |
| Q. RewritingRetriever=BM25, Reader=FiD, Answer History Source=Predicted answers2022.04 | 22.1 | — | — | — | — | — | — | — | — | — | — | |
| CONVINSEAnswer History Source=Predicted answers2022.04 | 21.7 | — | — | — | — | — | — | — | — | — | — | |
| Prepend init+prevRetriever=BM25, Reader=FiD, Answer History Source=Predicted answers2022.04 | 19.5 | — | — | — | — | — | — | — | — | — | — | |
| Q. ResolutionRetriever=BM25, Reader=FiD, Answer History Source=Predicted answers2022.04 | 18.8 | — | — | — | — | — | — | — | — | — | — | |
| Prepend initRetriever=BM25, Reader=FiD, Answer History Source=Predicted answers2022.04 | 17.8 | — | — | — | — | — | — | — | — | — | — | |
| Prepend allRetriever=BM25, Reader=FiD, Answer History Source=Predicted answers2022.04 | 16.8 | — | — | — | — | — | — | — | — | — | — | |
| Q. RewritingRetriever=BM25, Reader=FiD, Answer History Source=Predicted answers2022.04 | 16.8 | — | — | — | — | — | — | — | — | — | — | |
| Prepend prevRetriever=BM25, Reader=FiD, Answer History Source=Predicted answers2022.04 | 16.2 | — | — | — | — | — | — | — | — | — | — | |
| Prepend prevRetriever=BM25, Reader=FiD, Answer History Source=Predicted answers2022.04 | 12.3 | — | — | — | — | — | — | — | — | — | — |