Dialogue State Tracking on MultiWOZ 2.1 (5%)
44.98Joint Goal AccSVAG + EDZ-DA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SVAG + EDZ-DAAugmentation method=EDZ-DA, Slot value permutation=true2024.06 | 44.98 | — | |
| SVAG (None)Augmentation method=None, Pre-defined user goal=None2024.06 | 43.54 | — | |
| SVAG + NeuralWOZAugmentation method=NeuralWOZ, Pre-defined user goal=Manual templates2024.06 | 43.51 | — | |
| SVAG + EDZ-DA w/o PAugmentation method=EDZ-DA w/o P, Slot value permutation=false2024.06 | 43.3 | — | |
| SVAG + Simulated ChatsAugmentation method=Simulated Chats, Pre-defined user goal=Original data2024.06 | 41.09 | — | |
| FutureTODTraining Data=5%2023.06 | 29.1 | 94.1 | |
| TOD-BERTTraining Data=5%2023.06 | 28.6 | 93.8 | |
| BERT-mlmTraining Data=5%2023.06 | 28.1 | 93.9 | |
| DSETraining Data=5%2023.06 | 23.8 | 93 | |
| SimCSETraining Data=5%2023.06 | 21.1 | 91.6 | |
| BERTTraining Data=5%2023.06 | 19.6 | 92 |