User Satisfaction Estimation on MWOZ
58.1AccuracyASAP
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ASAPin-domain pre-training=false2023.05 | 58.1 | 58.1 | 54.7 | 55.6 | |
| ASAPIn-domain pre-training=false2023.05 | 56.3 | 55.1 | 55.4 | 55 | |
| USDAin-domain pre-training=true2023.05 | 52.9 | 51.8 | 50.2 | 50.6 | |
| USDAIn-domain pre-training=false2023.05 | 49.9 | 49.2 | 49 | 48.9 | |
| USDA (reproduced)in-domain pre-training=true2023.05 | 49.2 | 47.7 | 48.3 | 47.9 | |
| JointUSE + BERTin-domain pre-training=false2023.05 | 48.9 | 47.2 | 48 | 47.3 | |
| JointUSEin-domain pre-training=false2023.05 | 47.6 | 44.6 | 44.9 | 44.7 | |
| Co-GAT + BERTin-domain pre-training=false2023.05 | 47 | 46.4 | 47.2 | 46.3 | |
| USDAIn-domain pre-training=true, Reproduced=true2023.05 | 47 | 45.4 | 45.6 | 45.4 | |
| Co-GATin-domain pre-training=false2023.05 | 46.8 | 44.8 | 44 | 44.2 | |
| BERTIn-domain pre-training=false2023.05 | 46.1 | 45.5 | 47.4 | 45.9 | |
| JointDASin-domain pre-training=false2023.05 | 44.8 | 42.7 | 43 | 42.8 | |
| HiGRUIn-domain pre-training=false2023.05 | 44.6 | 43.7 | 44.3 | 43.7 | |
| HANIn-domain pre-training=false2023.05 | 39 | 37.1 | 37.1 | 36.8 |