User Satisfaction Estimation on JDDC
65.4AccuracyASAP
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ASAPIn-domain pre-training=false2023.05 | 65.4 | 64.2 | 68.5 | 65.3 | |
| ASAPin-domain pre-training=false2023.05 | 64.1 | 62.6 | 67.3 | 63.9 | |
| JointUSE + BERTin-domain pre-training=false2023.05 | 63.8 | 60.8 | 58.6 | 59.2 | |
| USDAin-domain pre-training=true2023.05 | 63 | 61.4 | 65.7 | 62.6 | |
| USDAIn-domain pre-training=false2023.05 | 61.8 | 62.8 | 63.7 | 61.7 | |
| USDA (reproduced)in-domain pre-training=true2023.05 | 61.6 | 60 | 62.3 | 60.7 | |
| Co-GAT + BERTin-domain pre-training=false2023.05 | 60.6 | 60.6 | 63.7 | 61 | |
| BERTIn-domain pre-training=false2023.05 | 60.4 | 59.8 | 58.8 | 59.5 | |
| Co-GATin-domain pre-training=false2023.05 | 60.2 | 59.3 | 62.9 | 60.1 | |
| USDAIn-domain pre-training=true, Reproduced=true2023.05 | 60.2 | 60.9 | 66 | 61 | |
| HiGRUIn-domain pre-training=false2023.05 | 59.7 | 57.3 | 50.4 | 52 | |
| JointDASin-domain pre-training=false2023.05 | 58.5 | 55.8 | 55.1 | 55.4 | |
| HANIn-domain pre-training=false2023.05 | 58.4 | 54.2 | 50.1 | 51.2 | |
| JointUSEin-domain pre-training=false2023.05 | 58.3 | 56.6 | 58.7 | 57.2 |