Dialogue State Tracking on SGD (test)
86.5JGApaDST
Evaluation results
| Method | Links | ||
|---|---|---|---|
| paDSTPretrained Model=XLNet-large (340M), Single-Pass=false, System action annotations=true2023.06 | 86.5 | 94.8 | |
| D3ST (XXL)Pretrained Model=T5-XXL (11B), Single-Pass=true, System action annotations=false2023.06 | 86.4 | 98.8 | |
| SPLAT (Large)Pretrained Model=Longformer-large (340M), Single-Pass=true, System action annotations=false2023.06 | 85.3 | 97.6 | |
| MT-BERTPretrained Model=BERT-base (110M), Single-Pass=false, System action annotations=true2023.06 | 82.7 | 94.7 | |
| SPLAT (Base)Pretrained Model=Longformer-base (110M), Single-Pass=true, System action annotations=false2023.06 | 80.1 | 96.7 | |
| D3ST (Large)Pretrained Model=T5-large (770M), Single-Pass=true, System action annotations=false2023.06 | 80 | 97.1 | |
| D3ST (Base)Pretrained Model=T5-base (220M), Single-Pass=true, System action annotations=false2023.06 | 72.9 | 97.2 | |
| SGP-DSTPretrained Model=T5-base (220M), Single-Pass=false, System action annotations=false2023.06 | 72.2 | 91.8 | |
| MT-BERTPretrained Model=BERT-base (110M), Single-Pass=false, System action annotations=false2023.06 | 71.9 | — | |
| DaP (ind)Pretrained Model=T5-base (220M), Single-Pass=false, System action annotations=false2023.06 | 71.8 | 90.2 | |
| SGD baselinePretrained Model=BERT-base (110M), Single-Pass=false, System action annotations=false2023.06 | 25.4 | 90.6 |