Knowledge-grounded Dialogue Generation on WoW (Wizard of Wikipedia) unseen (test)
20.7ROUGE-1KAT-TSLF
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| KAT-TSLFexternal knowledge=with external knowledge2023.02 | 20.7 | — | — | — | — | — | — | — | 15.8 | 7.2 | |
| BART-large + KILMexternal knowledge=without external knowledge2023.02 | 18.8 | — | — | — | — | — | — | — | 24.9 | 4.5 | |
| BART-largeexternal knowledge=without external knowledge2023.02 | 18.5 | — | — | — | — | — | — | — | 18.7 | 4.3 | |
| BART-base + Mergeexternal knowledge=without external knowledge2023.02 | 18 | — | — | — | — | — | — | — | 26.8 | 4.2 | |
| BART-base + KILMexternal knowledge=without external knowledge2023.02 | 17.9 | — | — | — | — | — | — | — | 26.9 | 4.2 | |
| BART-baseexternal knowledge=without external knowledge2023.02 | 17.5 | — | — | — | — | — | — | — | 20.9 | 4 | |
| SKTexternal knowledge=with external knowledge2023.02 | 16.1 | — | — | — | — | — | — | — | 81.4 | 4.2 | |
| BART-base2022.05 | 11.85 | 6.51 | 1.65 | 5.16 | 20.9 | 0.1582 | — | — | — | — | |
| Transformer+KI2022.05 | 11.23 | 7.13 | 1.82 | 3.82 | 12.98 | 0.4162 | — | — | — | — | |
| Transformer2022.05 | 10.08 | 5.43 | 1.48 | 1.43 | 3.27 | 0.8467 | — | — | — | — | |
| DiffKS2022.05 | — | — | — | — | — | — | 3.7 | 3.7 | — | — | |
| DiffKS+KI2022.05 | — | — | — | — | — | — | 4 | 4.2 | — | — | |
| Human ResponseEvaluation Set=Base vs KI2022.05 | — | — | — | — | — | — | 4.5 | 4.5 | — | — | |
| Human ResponseEvaluation Set=DiffKS Comparison2022.05 | — | — | — | — | — | — | 4.4 | 4.2 | — | — | |
| Transformer2022.05 | — | — | — | — | — | — | 2.9 | 3.3 | — | — | |
| Transformer+KI2022.05 | — | — | — | — | — | — | 3.7 | 3.6 | — | — |