Multi-Session Dialogue Generation on MSC Human Evaluation 1.0 (test)
24.2Reference Own TopicSumMem-MSC 2.7B
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SumMem-MSC 2.7BScale=2.7B, Retrieval Type=FiD-RAG2021.07 | 24.2 | 26.4 | 78.3 | 59.3 | 3.68 | |
| SumMem-MSC 2.7BScale=2.7B, Retrieval Type=FiD2021.07 | 22.1 | 30.7 | 76.4 | 58.9 | 3.62 | |
| BST 2.7BScale=2.7B2021.07 | 19.9 | 14.5 | 69 | 53 | 3.14 | |
| SumMem-MSC 2.7BScale=2.7B, Retrieval Type=RAG2021.07 | 19.6 | 33.8 | 72.7 | 62.1 | 3.65 | |
| MSC 2.7BScale=2.7B, Truncation Length=1282021.07 | 15.8 | 21.8 | 75.8 | 56.5 | 3.29 | |
| MSC 2.7BScale=2.7B, Truncation Length=10242021.07 | 15 | 22.5 | 74.4 | 54.2 | 3.47 |