Entity Relation Extraction on FUNSD (test)
88.57F1 ScoreROAP
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ROAPBackbone=GeoLayoutLM2026.01 | 88.57 | 87.95 | 89.19 | |
| GeoLayoutLM2026.01 | 88.1 | 87.13 | 89.1 | |
| ROAPBackbone=LayoutLMv32026.01 | 73.14 | 70.54 | 75.94 | |
| SERAVariation=+ GOLD LABEL2021.10 | 72.94 | 70.33 | 75.76 | |
| LayoutLMv32026.01 | 72.03 | 70.16 | 74 | |
| SERAVariation=+ MTL, AUG2021.10 | 65.96 | 63.68 | 68.42 | |
| SERAVariation=+ MTL2021.10 | 65.46 | 63.74 | 67.27 | |
| SERAEncoder=LayoutLM, Setting=Standard2021.10 | 64.6 | 61.89 | 67.56 | |
| SERAVariation=- AUTO LABEL2021.10 | 63.81 | 60.46 | 67.56 | |
| ROAPBackbone=LiLT2026.01 | 63.49 | 62.88 | 64.12 | |
| LiLT2026.01 | 63.35 | 60.93 | 65.97 | |
| SERAVariation=- FEATURE SCORER2021.10 | 60.35 | 60.49 | 60.2 | |
| SERAEncoder=BERT2021.10 | 57.08 | 55.39 | 58.87 | |
| GNN + MLPSource=Published results, Reference=Carbonell et al. (2021)2021.10 | 39 | — | — | |
| LAYOUTLMImplementation=Our reimplementation, Reference=Xu et al. (2020b)2021.10 | 30.62 | 30.41 | 30.82 | |
| BERTImplementation=Our reimplementation, Reference=G. Jaume and Thiran (2019)2021.10 | 29.15 | 29.59 | 28.72 | |
| BIAFFINEImplementation=Our reimplementation, Reference=Dozat and Manning (2017)2021.10 | 8.99 | 7.46 | 11.31 | |
| SERAEncoder=WORD2VEC2021.10 | 2.56 | 1.87 | 4.03 |