User Satisfaction Estimation on SGD
64.8AccuracyASAP
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ASAPin-domain pre-training=false2023.05 | 64.8 | 63 | 62.3 | 62.6 | |
| ASAPIn-domain pre-training=false2023.05 | 64.5 | 62.4 | 61.9 | 62.1 | |
| USDAin-domain pre-training=true2023.05 | 62.5 | 60.3 | 59.9 | 60.1 | |
| USDAIn-domain pre-training=false2023.05 | 61.4 | 60.1 | 55.7 | 57 | |
| USDA (reproduced)in-domain pre-training=true2023.05 | 61.3 | 58.4 | 59.5 | 58.8 | |
| USDAIn-domain pre-training=true, Reproduced=true2023.05 | 60.2 | 60.1 | 57.6 | 58.2 | |
| JointUSE + BERTin-domain pre-training=false2023.05 | 59 | 57.4 | 57.1 | 57.3 | |
| Co-GAT + BERTin-domain pre-training=false2023.05 | 58.6 | 55.2 | 55.7 | 55.5 | |
| JointUSEin-domain pre-training=false2023.05 | 57.4 | 55 | 54.8 | 54.7 | |
| Co-GATin-domain pre-training=false2023.05 | 56.8 | 55.9 | 55.9 | 55.6 | |
| BERTIn-domain pre-training=false2023.05 | 56.2 | 55 | 53.7 | 53.7 | |
| JointDASin-domain pre-training=false2023.05 | 55.7 | 52.2 | 52.4 | 52.3 | |
| HiGRUIn-domain pre-training=false2023.05 | 50 | 47.3 | 48.4 | 47.5 | |
| HANIn-domain pre-training=false2023.05 | 47.7 | 47.1 | 44.8 | 44.9 |