Goal-oriented Dialog Generation on MultiWoZ 2.0 (test)
100AccuracyGold
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Gold2022.03 | 100 | 100 | 100 | 0.78 | 0.86 | |
| POKIbase model=SimpleTOD, Entailment constraint=true, Knowledge Fidelity constraint=true2022.03 | 71.1 | 13.7 | 74.5 | 3.78 | 2.67 | |
| Arrangeryear=20212022.03 | 70.2 | 12.3 | 68.5 | 0.93 | 1.15 | |
| Rewriteryear=20212022.03 | 70.2 | 12.1 | 69.4 | 1.03 | 1.45 | |
| KCopy2022.03 | 70.1 | 4.1 | 62.3 | 3.16 | 2.41 | |
| SimpleTODyear=20202022.03 | 70.1 | 15 | 79.2 | 0.56 | 0.9 | |
| POKIbase model=SimpleTOD, Entailment constraint=true, Knowledge Fidelity constraint=false2022.03 | 70 | 12.3 | 71.2 | 0.95 | 1.19 | |
| POKIbase model=SimpleTOD, Entailment constraint=false, Knowledge Fidelity constraint=true2022.03 | 69.9 | 10.9 | 67.8 | 3.67 | 2.56 | |
| SimpleTOD+year=20212022.03 | 69.8 | 12.1 | 68.1 | 0.81 | 1.11 |