Coherence Score Prediction on GCDC
0.69Yahoo Coherence ScoreVanilla Transformer
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Vanilla Transformertraining data=all domains2021.09 | 0.69 | 0.689 | 0.599 | 0.493 | 0.618 | |
| MTL with Transformerstraining data=all domains2021.09 | 0.684 | 0.709 | 0.598 | 0.495 | 0.622 | |
| Hierarchical Transformertraining data=all domains2021.09 | 0.671 | 0.673 | 0.587 | 0.499 | 0.608 | |
| Vanilla Transformertraining data=individual domain2021.09 | 0.668 | 0.653 | 0.56 | 0.484 | 0.591 | |
| Hierarchical Transformertraining data=individual domain2021.09 | 0.662 | 0.599 | 0.512 | 0.452 | 0.556 | |
| MTL with Transformerstraining data=individual domain2021.09 | 0.655 | 0.666 | 0.561 | 0.468 | 0.588 | |
| Fact-aware Transformertraining data=individual domain2021.09 | 0.638 | 0.61 | 0.474 | 0.426 | 0.537 | |
| PARSEQ2021.09 | 0.519 | 0.448 | 0.454 | 0.329 | 0.438 | |
| SENTAVG2021.09 | 0.466 | 0.505 | 0.438 | 0.311 | 0.43 | |
| CNN-Egrid2021.09 | 0.204 | 0.251 | 0.258 | 0.104 | 0.204 | |
| EGRID2021.09 | 0.11 | 0.146 | 0.168 | 0.121 | 0.136 | |
| Flesch-Kincaid grade level2021.09 | 0.089 | 0.323 | 0.244 | 0.2 | 0.214 |