Dialogue State Tracking on MultiWOZ 2.1 (1%)
37.26Joint Goal AccSVAG + EDZ-DA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SVAG + EDZ-DAAugmentation method=EDZ-DA, Slot value permutation=true2024.06 | 37.26 | — | |
| SVAG + EDZ-DA w/o PAugmentation method=EDZ-DA w/o P, Slot value permutation=false2024.06 | 36.49 | — | |
| SVAG + NeuralWOZAugmentation method=NeuralWOZ, Pre-defined user goal=Manual templates2024.06 | 34.43 | — | |
| SVAG (None)Augmentation method=None, Pre-defined user goal=None2024.06 | 31.94 | — | |
| BERT-mlmTraining Data=1%2023.06 | 9.9 | 86.6 | |
| FutureTODTraining Data=1%2023.06 | 9.9 | 85.5 | |
| DSETraining Data=1%2023.06 | 9.8 | 86.3 | |
| TOD-BERTTraining Data=1%2023.06 | 8 | 85.3 | |
| SimCSETraining Data=1%2023.06 | 7.4 | 84.8 | |
| BERTTraining Data=1%2023.06 | 6.4 | 84.4 |