Dialogue State Tracking on MultiWOZ 2.1 (zero-shot)
38.86Attraction AccuracyHiCoLoRA
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| HiCoLoRAYear=2025, Base Model=PPTOD-small, Protocol=Zero-shot2025.09 | 38.86 | 20.41 | 30.96 | 44.49 | 68.91 | 40.8 | |
| DualLoRAYear=2024, Base Model=PPTOD-small, Protocol=Zero-shot2025.09 | 37.1 | 18.9 | 27.9 | 42.4 | 67.2 | 38.7 | |
| PrompterYear=2023, Base Model=PPTOD-small, Protocol=Zero-shot2025.09 | 35.8 | 19.2 | 26 | 39 | 66.3 | 37.2 | |
| DCCYear=2023, Base Model=T5-small, Protocol=Zero-shot2025.09 | 35.8 | 24.8 | 22.9 | 40.2 | 65.9 | 37.9 | |
| T5DST*Year=2021, Base Model=PPTOD-small, Protocol=Zero-shot2025.09 | 35.5 | 20 | 25.3 | 35.3 | 65.6 | 36.4 | |
| SlotDM-DSTYear=2022, Base Model=T5-small, Protocol=Zero-shot2025.09 | 33.9 | 18.9 | 20.8 | 37 | 66.3 | 35.4 | |
| T5DSTYear=2021, Base Model=T5-small, Protocol=Zero-shot2025.09 | 31.9 | 20.7 | 20.1 | 28.8 | 64.1 | 33.1 | |
| GPT2-DSTYear=2021, Base Model=GPT2-base, Protocol=Zero-shot2025.09 | 23.7 | 18.5 | 21.1 | 24.3 | 59.1 | 29.3 | |
| SUMBTYear=2019, Base Model=BERT-base, Protocol=Zero-shot2025.09 | 22.6 | 19.1 | 16.5 | 22.5 | 59.5 | 28 | |
| MA-DSTYear=2020, Base Model=TRADE, Protocol=Zero-shot2025.09 | 22.5 | 16.3 | 13.6 | 22.8 | 59.3 | 26.9 | |
| TRADEYear=2019, Base Model=customized seq2seq, Protocol=Zero-shot2025.09 | 20.1 | 14.2 | 12.6 | 22.4 | 59.2 | 25.7 |