Dialog State Tracking on MultiWOZ 2.0 (test)
55.03Joint Goal AccuracyFPDSC-turn
Evaluation Results
| Method | Links | |
|---|---|---|
| FPDSC-turnApproach Category=Classification-based, Requires Full Ontology=true2021.09 | 55.03 | |
| MDTOD2023.05 | 54.41 | |
| DS-PicklistApproach Category=Classification-based, Requires Full Ontology=true2021.09 | 54.39 | |
| BORT2023.05 | 54 | |
| PPTODlargeApproach Category=Generation-based, Requires Full Ontology=false2021.09 | 53.89 | |
| PPTODevaluation_corrected=true2023.05 | 53.57 | |
| MTTOD2023.05 | 53.56 | |
| PPTODbaseApproach Category=Generation-based, Requires Full Ontology=false2021.09 | 53.37 | |
| DST-Picklist2020.05 | 53.3 | |
| SOLOISTApproach Category=Generation-based, Requires Full Ontology=false2021.09 | 53.2 | |
| SOLOIST2020.05 | 53.2 | |
| SOLOIST2023.05 | 53.2 | |
| FPDSC-dualApproach Category=Classification-based, Requires Full Ontology=true2021.09 | 53.17 | |
| CHANApproach Category=Classification-based, Requires Full Ontology=true2021.09 | 52.68 | |
| UBARApproach Category=Generation-based, Requires Full Ontology=false2021.09 | 52.59 | |
| T5-Basebackbone=T5-Base2023.05 | 52.16 | |
| MinTLApproach Category=Generation-based, Requires Full Ontology=false2021.09 | 52.1 | |
| MinTL2020.05 | 52.1 | |
| PPTODsmallApproach Category=Generation-based, Requires Full Ontology=false2021.09 | 51.5 | |
| DSTQAApproach Category=Generation-based, Requires Full Ontology=true2021.09 | 51.44 | |
| DSTQA2020.05 | 51.44 | |
| DSTQA2023.05 | 51.44 | |
| SOM-DSTApproach Category=Generation-based, Requires Full Ontology=false2021.09 | 51.38 | |
| SOM-DST2020.05 | 51.38 | |
| SOM-DST2023.05 | 51.38 | |
| SimpleTODevaluation_corrected=true2023.05 | 51.37 | |
| SSTApproach Category=Classification-based, Requires Full Ontology=true2021.09 | 51.17 | |
| SST2020.05 | 51.17 | |
| NADST2020.05 | 50.52 | |
| COMERApproach Category=Generation-based, Requires Full Ontology=false2021.09 | 48.79 | |
| COMER2020.05 | 48.79 | |
| COMER2023.05 | 48.79 | |
| TRADEApproach Category=Generation-based, Requires Full Ontology=false2021.09 | 48.62 | |
| TRADE2020.05 | 48.62 | |
| TRADE2023.05 | 48.62 | |
| SUMBTApproach Category=Classification-based, Requires Full Ontology=false2021.09 | 46.65 | |
| SUMBT2020.05 | 46.65 | |
| HyST2020.05 | 44.24 | |
| Neural ReadingApproach Category=Generation-based, Requires Full Ontology=false2021.09 | 41.1 | |
| Neural Reading2020.05 | 41.1 | |
| FJSTApproach Category=Classification-based, Requires Full Ontology=false2021.09 | 40.2 | |
| FJST2020.05 | 40.2 | |
| GCEApproach Category=Classification-based, Requires Full Ontology=false2021.09 | 36.27 | |
| GCE2020.05 | 36.27 | |
| GLADApproach Category=Classification-based, Requires Full Ontology=false2021.09 | 35.57 | |
| GLAD2020.05 | 35.57 | |
| MDBT2020.05 | 15.57 |