Conversational Response Generation on Reddit (test)
0.947Dist-1HUMAN
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| HUMANDescription=Gold reference of the query2021.05 | 0.947 | — | — | — | — | 0.897 | 4.235 | 4.086 | |
| CE+MLMLoss Function=Cross-Entropy (CE), Augmentation=Masked Language Modeling (MLM)2021.05 | 0.917 | 6.82 | 0.76 | 0.1665 | 0.0131 | 0.868 | 3.552 | 3.184 | |
| WD+MLMLoss Function=Wasserstein Distance (WD), Augmentation=Masked Language Modeling (MLM)2021.05 | 0.913 | 7.09 | 0.57 | 0.1575 | 0.0125 | 0.881 | 3.575 | 3.188 | |
| CE+OURSLoss Function=Cross-Entropy (CE), Augmentation=OURS (Current Paper)2021.05 | 0.894 | 7.1 | 0.85 | 0.1641 | 0.0144 | 0.864 | 3.632 | 3.37 | |
| WD+OURSLoss Function=Wasserstein Distance (WD), Augmentation=OURS (Current Paper)2021.05 | 0.893 | 7.01 | 0.84 | 0.1656 | 0.0139 | 0.855 | 3.629 | 3.447 | |
| CE+BTLoss Function=Cross-Entropy (CE), Augmentation=Back-Translation (BT)2021.05 | 0.892 | 7.38 | 0.68 | 0.1704 | 0.0133 | 0.851 | 3.557 | 3.249 | |
| CELoss Function=Cross-Entropy (CE), Augmentation=None2021.05 | 0.889 | 7.22 | 0.75 | 0.1635 | 0.0138 | 0.855 | 3.571 | 3.314 | |
| WD+BTLoss Function=Wasserstein Distance (WD), Augmentation=Back-Translation (BT)2021.05 | 0.881 | 6.92 | 0.81 | 0.1597 | 0.0129 | 0.853 | 3.579 | 3.279 | |
| WDLoss Function=Wasserstein Distance (WD), Augmentation=None2021.05 | 0.872 | 7.1 | 0.87 | 0.1509 | 0.0133 | 0.863 | 3.644 | 3.354 |