Dialogue Generation on Reddit Conversation Corpus (test)
36.03PPLDialoGPT
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| DialoGPT2021.05 | 36.03 | 5.87 | 5.2 | 77.8 | 35.4 | 58.39 | 1,041 | 49.86 | |
| Mariafull_model=true2021.05 | 54.38 | 14.21 | 13.02 | 82.54 | 44.14 | 65.98 | 844 | 33.35 | |
| Maria (w/o VKB & MCP)VKB=false, MCP=false2021.05 | 62.64 | 11.5 | 10.45 | 77.52 | 41.27 | 61 | 692 | 28.53 | |
| Maria (w/o images)images=false2021.05 | 64.75 | 10.7 | 9.15 | 78.89 | 39.88 | 62.39 | 688 | 28.01 | |
| Maria (w/o VKB)VKB=false2021.05 | 65.51 | 12.76 | 11.76 | 82.49 | 40.22 | 64.49 | 715 | 29.44 | |
| Maria (w/o MCP)MCP=false2021.05 | 66.71 | 13.91 | 11.6 | 81.59 | 41.06 | 64.1 | 836 | 31.8 | |
| Maria (w/o concepts)concepts=false2021.05 | 69.24 | 11.43 | 10.61 | 82.96 | 41.02 | 65.07 | 456 | 16.44 | |
| Maria (w/o images & concepts)images=false, concepts=false2021.05 | 69.5 | 10.75 | 8.34 | 80.62 | 41.15 | 64.25 | 369 | 10.11 | |
| ReCoSa2021.05 | 71.75 | 12.75 | 11.75 | 79.84 | 42.29 | 63.02 | 66 | 3.83 | |
| ImgVAE2021.05 | 72.06 | 12.58 | 12.05 | 79.95 | 42.38 | 63.55 | 152 | 6.34 | |
| Seq2Seq2021.05 | 77.27 | 12.21 | 10.81 | 78.38 | 40.06 | 62.64 | 53 | 1.96 | |
| VHRED2021.05 | 78.01 | 12.22 | 11.82 | 75.57 | 39.24 | 62.07 | 87 | 3.49 | |
| HRED2021.05 | 84.02 | 11.68 | 11.29 | 75.54 | 37.49 | 60.41 | 89 | 3.21 |