Dialogue State Tracking on MultiWOZ 2.3 (test)
63JGATripPy
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TripPyHistory=Full2021.08 | 63 | — | |
| PegasusHistory=Full2021.08 | 60.2 | — | |
| T5 (span+ARLM)History=Full2021.08 | 59.9 | — | |
| T5 (span)History=Full2021.08 | 59.3 | — | |
| T5 (ARLM)History=Full2021.08 | 58.9 | — | |
| SAVNHistory=Full2021.08 | 58 | — | |
| SOM-DSTHistory=Full2021.08 | 55.5 | — | |
| SUMBTHistory=Full2021.08 | 52.9 | — | |
| SimpleTODHistory=Full2021.08 | 51.3 | — | |
| TRADEHistory=Full2021.08 | 49.2 | — | |
| No pre-trainHistory=Full, Pre-training=false2021.08 | 28.1 | — | |
| SVAGAugmentation=None, Data ratio=1%2024.06 | — | 30.35 | |
| SVAGAugmentation=None, Data ratio=5%2024.06 | — | 65.63 | |
| SVAG + EDZ-DA (Ours w/o P)Augmentation=Ours w/o P, Data ratio=1%2024.06 | — | 64.07 | |
| SVAG + EDZ-DA (Ours w/o P)Augmentation=Ours w/o P, Data ratio=5%2024.06 | — | 71.08 | |
| SVAG + EDZ-DA (Ours)Augmentation=Ours, Data ratio=1%2024.06 | — | 64.72 | |
| SVAG + EDZ-DA (Ours)Augmentation=Ours, Data ratio=5%2024.06 | — | 73.41 | |
| SVAG + NeuralWOZAugmentation=NeuralWOZ, Data ratio=1%2024.06 | — | 35.54 | |
| SVAG + NeuralWOZAugmentation=NeuralWOZ, Data ratio=5%2024.06 | — | 61.87 | |
| SVAG + Simulated ChatsAugmentation=Simulated Chats, Data ratio=5%2024.06 | — | 54.73 |