Open Domain Dialogue on Commonsense Dialogue Dataset (test)
0.3298BLEU-1SaBART
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| SaBARTmode=full system2023.06 | 0.3298 | 0.2113 | 0.1467 | 0.0945 | 2.9226 | 3.8386 | 4.0763 | 4.1121 | 0.1674 | |
| SaBARTdynamic-aggregation=disabled2023.06 | 0.2967 | 0.1909 | 0.1322 | 0.0846 | 2.3889 | 3.1635 | 3.3618 | 3.3914 | 0.1647 | |
| SaBARTstatic-aggregation=disabled2023.06 | 0.2927 | 0.188 | 0.1299 | 0.0831 | 2.3712 | 3.1593 | 3.3623 | 3.3928 | 0.1684 | |
| ConceptFlow2023.06 | 0.2451 | 0.1047 | 0.0493 | 0.0246 | 1.6137 | 1.7956 | 1.8265 | 1.8329 | 0.0942 | |
| UniLM2023.06 | 0.2019 | 0.073 | 0.0305 | 0.0138 | 1.3562 | 1.4919 | 1.5082 | 1.5101 | 0.0796 | |
| MemNet2023.06 | 0.1741 | 0.0604 | 0.0246 | 0.0112 | 1.0975 | 1.1847 | 1.196 | 1.1977 | 0.0632 | |
| Seq2Seq2023.06 | 0.1702 | 0.0579 | 0.0226 | 0.0098 | 1.023 | 1.0963 | 1.1056 | 1.1069 | 0.0611 | |
| CopyNet2023.06 | 0.1589 | 0.0549 | 0.0226 | 0.0106 | 0.9899 | 1.0664 | 1.077 | 1.0788 | 0.061 | |
| SaBARTexternal-knowledge=disabled, equivalent-to=vanilla BART2023.06 | 0.1446 | 0.0578 | 0.0285 | 0.0155 | 1.0381 | 1.1653 | 1.2245 | 1.2327 | 0.0931 | |
| CCM2023.06 | 0.1413 | 0.0484 | 0.0192 | 0.0084 | 0.8362 | 0.9 | 0.9082 | 0.9095 | 0.063 |