Dialog Generation on DSTC7-AVSD (test)
0.832BLEU-1DialogVED w/o latent
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| DialogVED w/o latentdecoding strategy=beam search, beam size=5, latent variable configuration=without latent2022.04 | 0.832 | 0.705 | 0.598 | 0.506 | 0.314 | 0.638 | 1.386 | |
| ProphetNet2022.04 | 0.824 | 0.691 | 0.582 | 0.487 | 0.313 | 0.635 | 1.382 | |
| ProphetNet2023.01 | 0.824 | 0.691 | 0.582 | 0.487 | 0.313 | 0.635 | 1.382 | |
| DialogVEDdecoding strategy=beam search, beam size=5, latent variable configuration=with latent, latent size=642022.04 | 0.822 | 0.692 | 0.582 | 0.489 | 0.312 | 0.636 | 1.391 | |
| DialogVED2023.01 | 0.822 | 0.692 | 0.582 | 0.489 | 0.312 | 0.636 | 1.391 | |
| DialogVED - Greedydecoding strategy=greedy, latent variable configuration=with latent, latent size=642022.04 | 0.817 | 0.685 | 0.575 | 0.481 | 0.306 | 0.629 | 1.356 | |
| LMEDRBackbone=BART-large, Decoding=Beam search2023.01 | 0.801 | 0.68 | 0.576 | 0.488 | 0.316 | 0.631 | 1.403 | |
| PLATO2022.04 | 0.784 | 0.637 | 0.525 | 0.435 | 0.286 | 0.596 | 1.209 | |
| PLATO2023.01 | 0.784 | 0.637 | 0.525 | 0.435 | 0.286 | 0.596 | 1.209 | |
| CMU Sinbad's2022.04 | 0.718 | 0.584 | 0.478 | 0.394 | 0.267 | 0.563 | 1.094 | |
| CMU2023.01 | 0.718 | 0.584 | 0.478 | 0.394 | 0.267 | 0.563 | 1.094 | |
| AVSD Baseline2022.04 | 0.629 | 0.485 | 0.383 | 0.309 | 0.215 | 0.487 | 0.746 |