Catalog Extraction on ChCatExt (test)
90.634Heading PrecisionTRACER
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| TRACERPLM=RBT3, Constraints=True2023.04 | 90.634 | 90.341 | 90.486 | 83.031 | 85.673 | 84.328 | 81.017 | 83.818 | 82.39 | |
| TRACER (w/o Constraints)PLM=RBT3, Constraints=False2023.04 | 89.911 | 89.713 | 89.811 | 82.491 | 84.948 | 83.698 | 80.216 | 83.035 | 81.596 | |
| TRACER w/ WikiBertPLM=WikiBert, Constraints=True2023.04 | 88.671 | 89.785 | 89.221 | 83.308 | 85.025 | 84.156 | 80.82 | 83.357 | 82.063 | |
| PipelinePLM=RBT3, architecture=TextCNN [9], max_heading_depth=82023.04 | 88.637 | 86.595 | 87.601 | 81.627 | 82.475 | 82.047 | 76.837 | 77.338 | 77.085 | |
| TaggingPLM=RBT3, architecture=LSTM and CRF, max_heading_depth=82023.04 | 87.456 | 88.241 | 87.846 | 81.079 | 81.611 | 81.344 | 77.746 | 78.8 | 78.269 |