End-to-end Dialogue Modelling on MultiWOZ 2.0 (test)
95.4Inform RateUBAR
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| UBAR2021.11 | 95.4 | 80.7 | 17 | 105.05 | |
| GALAXYPre-training=true2021.11 | 94.4 | 85.3 | 20.5 | 110.35 | |
| GALAXYInitialization strategy=original weights of UniLM, Pre-training=false2021.11 | 93.1 | 81 | 18.44 | 105.49 | |
| PPTOD base2021.09 | 89.2 | 79.4 | 18.62 | 102.92 | |
| PPTOD2021.11 | 89.2 | 79.4 | 18.62 | 102.92 | |
| PPTOD small2021.09 | 87.8 | 75.3 | 19.89 | 101.44 | |
| TOP+NOD2021.09 | 86.9 | 76.2 | 20.58 | 102.13 | |
| DoTS2021.11 | 86.59 | 74.14 | 15.06 | 95.43 | |
| SOLOIST2021.09 | 85.5 | 72.9 | 16.54 | 95.74 | |
| SOLOIST2021.11 | 85.5 | 72.9 | 16.54 | 95.74 | |
| TOPS2021.09 | 85.2 | 72.9 | 17 | 96.05 | |
| MinTL+2021.09 | 84.88 | 74.91 | 17.89 | 97.78 | |
| MinTL2021.11 | 84.88 | 74.91 | 17.89 | 97.79 | |
| SimpleTOD2021.09 | 84.4 | 70.1 | 15.01 | 92.26 | |
| SimpleTOD2021.11 | 84.4 | 70.1 | 15.01 | 92.26 | |
| PPTOD large2021.09 | 82.6 | 74.1 | 19.21 | 97.56 | |
| UBAROracle dialogue states history=true2021.09 | 81.4 | 71.02 | 16.21 | 94.27 | |
| HIER-Joint2021.09 | 80.5 | 71.7 | 19.74 | 95.84 | |
| LABES-S2S2021.09 | 78.07 | 67.06 | 18.13 | 90.69 | |
| DAMD2021.09 | 76.33 | 60.4 | 16.6 | 84.97 | |
| MD-Sequicity2021.09 | 75.72 | 58.32 | 15.4 | 82.4 | |
| Sequicity2021.09 | 66.41 | 45.32 | 15.54 | 71.41 |