List your company
ResearchFormerly WizWand

Dialog State Tracking on MultiWOZ 2.0 (test)

55.03Joint Goal AccuracyFPDSC-turn
13.991624.645835.345.9542May 11, 2020Nov 11, 2020May 15, 2021Nov 16, 2021May 20, 2022Nov 21, 2022May 25, 2023
Updated 8mo ago

Evaluation results

MethodLinks
FPDSC-turnApproach Category=Classification-based, Requires Full Ontology=true2021.0955.03
MDTOD2023.0554.41
DS-PicklistApproach Category=Classification-based, Requires Full Ontology=true2021.0954.39
BORT2023.0554
PPTODlargeApproach Category=Generation-based, Requires Full Ontology=false2021.0953.89
PPTODevaluation_corrected=true2023.0553.57
MTTOD2023.0553.56
PPTODbaseApproach Category=Generation-based, Requires Full Ontology=false2021.0953.37
DST-Picklist2020.0553.3
SOLOISTApproach Category=Generation-based, Requires Full Ontology=false2021.0953.2
SOLOIST2020.0553.2
SOLOIST2023.0553.2
FPDSC-dualApproach Category=Classification-based, Requires Full Ontology=true2021.0953.17
CHANApproach Category=Classification-based, Requires Full Ontology=true2021.0952.68
UBARApproach Category=Generation-based, Requires Full Ontology=false2021.0952.59
T5-Basebackbone=T5-Base2023.0552.16
MinTLApproach Category=Generation-based, Requires Full Ontology=false2021.0952.1
MinTL2020.0552.1
PPTODsmallApproach Category=Generation-based, Requires Full Ontology=false2021.0951.5
DSTQAApproach Category=Generation-based, Requires Full Ontology=true2021.0951.44
DSTQA2020.0551.44
DSTQA2023.0551.44
SOM-DSTApproach Category=Generation-based, Requires Full Ontology=false2021.0951.38
SOM-DST2020.0551.38
SOM-DST2023.0551.38
SimpleTODevaluation_corrected=true2023.0551.37
SSTApproach Category=Classification-based, Requires Full Ontology=true2021.0951.17
SST2020.0551.17
NADST2020.0550.52
COMERApproach Category=Generation-based, Requires Full Ontology=false2021.0948.79
COMER2020.0548.79
COMER2023.0548.79
TRADEApproach Category=Generation-based, Requires Full Ontology=false2021.0948.62
TRADE2020.0548.62
TRADE2023.0548.62
SUMBTApproach Category=Classification-based, Requires Full Ontology=false2021.0946.65
SUMBT2020.0546.65
HyST2020.0544.24
Neural ReadingApproach Category=Generation-based, Requires Full Ontology=false2021.0941.1
Neural Reading2020.0541.1
FJSTApproach Category=Classification-based, Requires Full Ontology=false2021.0940.2
FJST2020.0540.2
GCEApproach Category=Classification-based, Requires Full Ontology=false2021.0936.27
GCE2020.0536.27
GLADApproach Category=Classification-based, Requires Full Ontology=false2021.0935.57
GLAD2020.0535.57
MDBT2020.0515.57