XBRL Tagging on FiNER-139 1.0 (dev)
84.8μ-PrecisionSEC-BERT-SHAPE
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SEC-BERT-SHAPEBackbone=SEC-BERT, Numeric Strategy=[SHAPE]2022.03 | 84.8 | 85.8 | 85.3 | |
| SEC-BERT-NUMBackbone=SEC-BERT, Numeric Strategy=[NUM]2022.03 | 82.5 | 84.4 | 83.7 | |
| FIN-BERT + [SHAPE]Backbone=FIN-BERT, Numeric Strategy=[SHAPE]2022.03 | 82.3 | 84 | 83.2 | |
| BERT + [SHAPE]Backbone=BERT, Numeric Strategy=[SHAPE]2022.03 | 82.1 | 82.6 | 82.3 | |
| FIN-BERT + [NUM]Backbone=FIN-BERT, Numeric Strategy=[NUM]2022.03 | 81.1 | 82.5 | 81.8 | |
| BERT + [NUM]Backbone=BERT, Numeric Strategy=[NUM]2022.03 | 79.4 | 83 | 81.2 | |
| BERT + CRFBackbone=BERT, Numeric Strategy=None, Decoding=CRF2022.03 | 78.3 | 83.6 | 80.9 | |
| SEC-BERTBackbone=SEC-BERT, Numeric Strategy=None2022.03 | 75.2 | 82.7 | 78.8 | |
| BERTBackbone=BERT, Numeric Strategy=None2022.03 | 74.9 | 82 | 78.2 | |
| FIN-BERTBackbone=FIN-BERT, Numeric Strategy=None2022.03 | 73.9 | 81.4 | 77.5 |