Dialogue State Tracking on MultiWOZ 2.0 (test)
57.23Joint Goal AccuracyESAinsTOD (GT)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ESAinsTOD (GT)Approach category=Generation-based, Backbone=Llama 2 7B, Evaluation protocol=Ground Truth2026.03 | 57.23 | — | |
| DSS-DSTApproach category=Hybrid, Full ontology requirement=true2026.03 | 56.93 | — | |
| ESAinsTODApproach category=Generation-based, Backbone=Llama 2 7B2026.03 | 55.9 | — | |
| MoNETPre-trained Model=BERT-base2022.11 | 55.48 | 97.55 | |
| FPDSC-turnApproach category=Classification-based, Full ontology requirement=true2026.03 | 55.03 | — | |
| Llama 2 7BApproach category=Generation-based, Evaluation protocol=Fine-tuned2026.03 | 54.92 | — | |
| DS-GraphPre-trained Model=GPT22022.11 | 54.86 | 97.47 | |
| STARPre-trained Model=BERT-base2022.11 | 54.53 | — | |
| SAVNPre-trained Model=BERT-base2022.11 | 54.52 | 97.42 | |
| DST-PicklistPre-trained Model=BERT-base2022.11 | 54.39 | — | |
| DST-PicklistApproach category=Classification-based, Full ontology requirement=true2026.03 | 54.39 | — | |
| BaselinePre-trained Model=BERT-base2022.11 | 54.38 | 97.47 | |
| PPTODPre-trained Model=T5-large2022.11 | 53.89 | — | |
| PPTODApproach category=Generation-based, Task-specific training (DST)=true, Dataset-specific fine-tuning=true2026.03 | 53.89 | — | |
| SOLOIST (DST)Approach category=Generation-based, Task-specific training (DST)=true2026.03 | 53.2 | — | |
| FPDSC-dualApproach category=Classification-based, Full ontology requirement=true2026.03 | 53.17 | — | |
| CHANApproach category=Classification-based, Full ontology requirement=true2026.03 | 52.68 | — | |
| UBAR (DST)Approach category=Generation-based, Task-specific training (DST)=true2026.03 | 52.59 | — | |
| PIN2022.11 | 52.44 | 97.28 | |
| DS-DSTApproach category=Hybrid2026.03 | 52.24 | — | |
| CSFN-DSTPre-trained Model=BERT-base2022.11 | 52.23 | — | |
| MinTLApproach category=Generation-based2026.03 | 52.1 | — | |
| SOM-DSTPre-trained Model=BERT-base2022.11 | 51.72 | — | |
| SOM-DSTApproach category=Generation-based2026.03 | 51.38 | — | |
| DSTQAApproach category=Hybrid, Full ontology requirement=true2026.03 | 51.36 | — | |
| SSTPre-trained Model=BERT-base2022.11 | 51.17 | — | |
| SSTApproach category=Classification-based, Full ontology requirement=true2026.03 | 51.17 | — | |
| TRADE2022.11 | 48.62 | 96.92 | |
| SUMBTPre-trained Model=BERT-base2022.11 | 42.4 | — |