Dialogue Disentanglement on Ubuntu IRC (test)
94.6VIStructural Characterization model
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Structural Characterization model2021.10 | 94.6 | 76.8 | 84.2 | 51.7 | 51.8 | 51.7 | |
| Ptr-Netcomponents=Joint train & Self-link2021.10 | 94.2 | 80.1 | — | 44.5 | 44.9 | 44.2 | |
| DialBERTfeatures=cov2021.10 | 93.2 | 72.8 | 79.7 | 44.8 | 42.1 | 47.9 | |
| Ptr-Nettraining=Joint train2021.10 | 93.1 | 71.3 | — | 39.7 | 37.2 | 42.5 | |
| Ptr-Netcomponents=Self-link2021.10 | 93 | 74.3 | — | 41.5 | 42.2 | 44.9 | |
| DialBERT2021.10 | 92.6 | 69.6 | 78.5 | 44.1 | 42.3 | 46.2 | |
| DialBERTfeatures=feature2021.10 | 92.4 | 66.6 | 77.6 | 42.2 | 38.8 | 46.3 | |
| DialBERTfeatures=future context2021.10 | 92.3 | 66.3 | 79.1 | 42.6 | 40 | 45.6 | |
| Ptr-Net2021.10 | 92.3 | 70.2 | — | 36 | 33 | 38.9 | |
| FeedForwardaggregation=10 vote2021.10 | 91.5 | — | 76 | 38 | 36.3 | 39.7 | |
| BERT_basenote=Our baseline2021.10 | 91.4 | 60.8 | 74.4 | 37.2 | 34 | 41.2 | |
| FeedForward2021.10 | 91.3 | — | 75.6 | 36.2 | 34.6 | 38 | |
| BERT2021.10 | 90.8 | 62.9 | 75 | 32.5 | 29.3 | 36.6 | |
| FeedForwardaggregation=10 union2021.10 | 86.2 | — | 62.5 | 33.4 | 40.4 | 28.5 | |
| Elsner2021.10 | 82.1 | — | 51.4 | 15.5 | 12.1 | 21.5 | |
| Lowe2021.10 | 80.6 | — | 53.7 | 8.9 | 10.8 | 7.6 | |
| FeedForwardaggregation=10 intersect2021.10 | 69.3 | — | 26.6 | 32.1 | 67 | 21.1 |