Dialogue Disentanglement on Ubuntu IRC (dev)
0.944VIStructural Characterization model
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Structural Characterization model2021.10 | 0.944 | 81.8 | 0.861 | 52.6 | 51 | 54.3 | |
| DialBERT2021.10 | 0.941 | 81.1 | 0.856 | 48 | 49.5 | 46.6 | |
| BERT_basenote=Our baseline2021.10 | 0.928 | 74.4 | 0.808 | 40.8 | 37.7 | 42.7 | |
| MHTfeatures=feature2021.10 | 0.898 | — | 0.754 | 35.8 | 32.7 | 34.2 | |
| ESIMfeatures=feature2021.10 | 0.877 | — | 0.658 | 22.6 | 18.9 | 28.3 | |
| Decom. Atten.features=feature2021.10 | 0.874 | — | 0.666 | 21.1 | 18.2 | 25.2 | |
| MHT2021.10 | 0.821 | — | 0.596 | 8.7 | 12.6 | 10.3 | |
| ESIM2021.10 | 0.721 | — | 0.44 | 1.4 | 2.2 | 1.8 | |
| Decom. Atten.2021.10 | 0.703 | — | 0.398 | 0.6 | 0.9 | 0.7 |