Dialogue State Tracking on SGD (Domain-wise JGA/AGA)
55.01JGA (Overall)HiCoLoRA
Evaluation results
| Method | Links | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| HiCoLoRAYear=2025, Zero-shot=true2025.09 | 55.01 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 87.8 | |
| HiCoLoRAYear=2025, Zero-shot=true2025.09 | 54.17 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 93.2 | |
| PrompterYear=2023, Zero-shot=true2025.09 | 51.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DualLoRAYear=2024, Zero-shot=true2025.09 | 50.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 88.8 | |
| T5DSTYear=2021, Zero-shot=true2025.09 | 48.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PrompterYear=2023, Zero-shot=true2025.09 | 48.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| T5DSTYear=2021, Zero-shot=true2025.09 | 46.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DualLoRAYear=2024, Zero-shot=true2025.09 | 46.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 82.8 | |
| SlotDM-DSTYear=2022, Zero-shot=true2025.09 | 43.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 86.3 | |
| Seq2seq-DUYear=2021, Zero-shot=true2025.09 | 31.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| HiCoLoRAYear=2025, Zero-shot=true2025.09 | 26.98 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 65 | |
| Transfer-QAYear=2021, Zero-shot=true2025.09 | 24.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 60.7 | |
| SGD-baselineYear=2019, Zero-shot=true2025.09 | 23.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 57.9 | |
| T5DSTYear=2021, Zero-shot=true2025.09 | 23.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PrompterYear=2023, Zero-shot=true2025.09 | 21.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DualLoRAYear=2024, Zero-shot=true2025.09 | 21.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 70.2 | |
| DCCYear=2023, Zero-shot=true2025.09 | 19.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Seq2seq-DUYear=2021, Zero-shot=true2025.09 | 16.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SlotDM-DSTYear=2022, Zero-shot=true2025.09 | 16.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 62 | |
| Transfer-QAYear=2021, Zero-shot=true2025.09 | 15.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 63.6 | |
| Transfer-QAYear=2021, Zero-shot=true2025.09 | 15.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 56.8 | |
| SGD-baselineYear=2019, Zero-shot=true2025.09 | 11.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 34.8 | |
| SGD-baselineYear=2019, Zero-shot=true2025.09 | 9.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 50.9 | |
| Seq2seq-DUYear=2021, Zero-shot=true2025.09 | 7.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DCCZero-shot=true2024.07 | — | — | — | — | — | — | — | — | — | 28.8 | — | — | — | 19.4 | — | 42.3 | — | — | |
| DualLoRAZero-shot=true2024.07 | — | 50.9 | 88.8 | 46.5 | 82.8 | 28.4 | 76.9 | 69.7 | 88.7 | 65.1 | 85.5 | 32.5 | 72.4 | 21.2 | 70.2 | 52.9 | 89.3 | — | |
| PROMPTERZero-shot=true2024.07 | — | 48.4 | — | 51.5 | — | — | — | 65.3 | — | 59.2 | — | — | — | 21.9 | — | 50.8 | — | — | |
| Seq2seq-DUZero-shot=true2024.07 | — | 16.8 | — | 31.9 | — | 15.9 | — | 23.1 | — | 4.9 | — | 12.3 | — | 7.2 | — | 16.8 | — | — | |
| SGD-baselineZero-shot=true2024.07 | — | 9.7 | 50.9 | 23.5 | 57.9 | 23.9 | 65.9 | 18 | 30.8 | 10.2 | 20 | 15.5 | 39.9 | 11.5 | 34.8 | 13.6 | 63.5 | — | |
| SlotDM-DSTZero-shot=true2024.07 | — | 43.9 | 86.3 | — | — | — | — | 36.6 | 61.4 | — | — | — | — | 16.5 | 62 | 46.7 | 86.9 | — | |
| T5DST*Zero-shot=true2024.07 | — | 46.8 | — | 48.8 | — | — | — | 55.5 | — | 59.2 | — | — | — | 23.3 | — | 53 | — | — | |
| Transfer-QAZero-shot=true2024.07 | — | 15.9 | 63.6 | 15.6 | 56.8 | 3.59 | 42.9 | 30.2 | 67.5 | 13.3 | 37.9 | 8.9 | 62.4 | 24.7 | 60.7 | 17.4 | 64.9 | — |