Knowledge-grounded Dialog Generation on MultiWOZ
98.7Win RatePOKI
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| POKIComparison Baseline=POKI w/o Entailment, Criteria=Coherent2022.03 | 98.7 | 0.8 | 0.73 | |
| POKIComparison Baseline=POKI w/o Entailment, Criteria=Engaging2022.03 | 98.7 | 0.6 | 0.8 | |
| POKIComparison Baseline=POKI w/o Kw Fidelity, Criteria=Interesting2022.03 | 98.7 | 0.8 | 0.75 | |
| POKIComparison Baseline=SimpleTOD, Criteria=Engaging2022.03 | 94.3 | 4.5 | 0.78 | |
| POKIComparison Baseline=SimpleTOD, Criteria=Coherent2022.03 | 93.2 | 4.4 | 0.76 | |
| POKIComparison Baseline=SimpleTOD, Criteria=Interesting2022.03 | 92.7 | 5.4 | 0.72 | |
| POKIComparison Baseline=Rewriter, Criteria=Interesting2022.03 | 91.2 | 8.3 | 0.72 | |
| POKIComparison Baseline=Rewriter, Criteria=Engaging2022.03 | 89.7 | 7.9 | 0.79 | |
| POKIComparison Baseline=POKI w/o Entailment, Criteria=Interesting2022.03 | 88.6 | 8.9 | 0.68 | |
| POKIComparison Baseline=Rewriter, Criteria=Humanlike2022.03 | 87.4 | 7.3 | 0.65 | |
| POKIComparison Baseline=Rewriter, Criteria=Coherent2022.03 | 85.6 | 10.2 | 0.75 | |
| POKIComparison Baseline=SimpleTOD, Criteria=Humanlike2022.03 | 85.4 | 10.7 | 0.68 | |
| POKIComparison Baseline=POKI w/o Kw Fidelity, Criteria=Humanlike2022.03 | 81.7 | 14 | 0.74 | |
| POKIComparison Baseline=POKI w/o Kw Fidelity, Criteria=Coherent2022.03 | 77.8 | 17.8 | 0.72 | |
| POKIComparison Baseline=POKI w/o Kw Fidelity, Criteria=Engaging2022.03 | 71.5 | 20.5 | 0.8 | |
| POKIComparison Baseline=POKI w/o Entailment, Criteria=Humanlike2022.03 | 61.9 | 30.5 | 0.71 | |
| POKIComparison Baseline=Gold, Criteria=Interesting2022.03 | 49.7 | 45.6 | 0.67 | |
| POKIComparison Baseline=Gold, Criteria=Engaging2022.03 | 42.4 | 37.4 | 0.78 | |
| POKIComparison Baseline=Gold, Criteria=Humanlike2022.03 | 29.7 | 37.8 | 0.66 | |
| POKIComparison Baseline=Gold, Criteria=Coherent2022.03 | 26.2 | 34.4 | 0.69 |