Sentence ordering on GCDC 1.0 (test)
96.3Yahoo AccuracyMTL with Transformers
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MTL with TransformersTraining data scope=all domains2021.09 | 96.3 | 99.1 | 99.4 | 99.8 | 98.7 | |
| Hierarchical TransformerTraining data scope=all domains2021.09 | 94.1 | 98.2 | 99.1 | 99.8 | 97.8 | |
| Vanilla TransformerTraining data scope=all domains2021.09 | 91 | 97.1 | 98.1 | 98.9 | 96.3 | |
| Hierarchical TransformerTraining data scope=individual domain2021.09 | 90.7 | 96.9 | 97.8 | 98.7 | 96 | |
| Vanilla TransformerTraining data scope=individual domain2021.09 | 88.2 | 94.4 | 95.2 | 98.1 | 94 | |
| MTL with TransformersTraining data scope=individual domain2021.09 | 88 | 94.2 | 95 | 98.6 | 94 | |
| Fact-aware TransformerTraining data scope=individual domain2021.09 | 84.2 | 98.7 | 83.2 | 84.1 | 87.6 | |
| LCD_BERTTraining data scope=individual domain2021.09 | 83.6 | 94.3 | 96.7 | 94.4 | 92.3 | |
| LCD-LTraining data scope=individual domain2021.09 | 82.1 | 87.7 | 87.1 | 94.8 | 87.9 | |
| LCD-GTraining data scope=individual domain2021.09 | 76.3 | 93.5 | 95.3 | 92.9 | 89.5 | |
| PARSEQTraining data scope=individual domain2021.09 | 58.3 | 88 | 87.1 | 74.2 | 76.9 | |
| EGRIDTraining data scope=individual domain2021.09 | 55.9 | 78.2 | 77.4 | 62.9 | 68.6 | |
| CNN-EgridTraining data scope=individual domain2021.09 | 54.8 | 75.5 | 73.1 | 58.7 | 65.5 |