Dialog act prediction on MRDA (test)
92.2AccuracyDAH-CRF + LDAutt
Evaluation results
| Method | Links | |
|---|---|---|
| DAH-CRF + LDAutttopic labels=automatically acquired utterance-level via LDA2018.10 | 92.2 | |
| Li et al. (2018a)2020.02 | 92.2 | |
| CRF-ASN2017.11 | 91.7 | |
| Chen et al. (2018)2019.04 | 91.7 | |
| Chen et al. (2018)2020.02 | 91.7 | |
| seq2seqBESTencoder=HGRU, decoder=hard guided attention, Btrain=5, Binf=12020.02 | 91.6 | |
| Seq2Seq2021.09 | 91.6 | |
| CRF-ASNreported_from=prior publication2018.10 | 91.4 | |
| CRF-ASN2021.09 | 91.4 | |
| Oursspeaker turn embeddings=true, topic-aware embeddings=false2021.09 | 91.4 | |
| DAH-CRF + LDAconvtopic labels=automatically acquired conversation-level via LDA2018.10 | 91.2 | |
| Our Method2019.04 | 91.1 | |
| SelfAtt-CRFreported_from=prior publication2018.10 | 91.1 | |
| Raheja and Tetreault (2019)2020.02 | 91.1 | |
| SelfAtt-CRF2021.09 | 91.1 | |
| Hierarchical Bi-LSTM-CRF2017.09 | 90.9 | |
| Bi-LSTM-CRF2017.11 | 90.9 | |
| Kumar et al. (2018)2019.04 | 90.9 | |
| Bi-LSTM-CRFreported_from=prior publication2018.10 | 90.9 | |
| Kumar et al. (2018)2020.02 | 90.9 | |
| Bi-LSTM-CRF2021.09 | 90.9 | |
| Ours-Speakerspeaker turn embeddings=false, topic-aware embeddings=false2021.09 | 90.7 | |
| DRLM-Cond2018.10 | 88.4 | |
| DRLM-Cond2021.09 | 88.4 | |
| LSTM-Softmax2017.09 | 86.8 | |
| LSTM-Softmax2017.11 | 86.8 | |
| Khanpour et al. (2016)2019.04 | 86.8 | |
| SGNN2021.09 | 86.7 | |
| CNNselection=highest validation accuracy run2016.03 | 84.6 | |
| CNN2017.09 | 84.6 | |
| CNN2017.11 | 84.6 | |
| Lee and Dernoncourt (2016)2019.04 | 84.6 | |
| LSTMselection=highest validation accuracy run2016.03 | 84.3 | |
| Ortega and Vu (2017)2019.04 | 84.3 | |
| CRF2017.11 | 83.9 | |
| Naive Bayesfeatures=transcribed words2016.03 | 82 | |
| Naiive Bayes2017.09 | 82 | |
| SVM2017.11 | 82 | |
| Graphical modelfeatures=transcribed words and previous predicted dialog acts2016.03 | 81.3 | |
| JAS2018.10 | 81.3 | |
| TF-IDF GloVe2019.04 | 78.7 | |
| Majority class2016.03 | 59.1 |