Entity Extraction on XFUND (test)
94.22F1 ScoreHGALayoutLM_BASE
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| HGALayoutLM_BASEHead=HGA, Model Size=BASE2024.07 | 94.22 | — | — | — | — | — | — | — | — | 92.79 | 95.7 | |
| GraphLayoutLM_BASEHead=Linear, Model Size=BASE2024.07 | 93.56 | — | — | — | — | — | — | — | — | 91.8 | 95.38 | |
| GraphLayoutLM_BASEHead=Linear, Model Size=BASE, replicated=true2024.07 | 93.48 | — | — | — | — | — | — | — | — | 92.3 | 94.69 | |
| LayoutLMv3_BASEHead=Linear, Model Size=BASE2024.07 | 92.02 | — | — | — | — | — | — | — | — | 89.8 | 94.35 | |
| XYLayoutLMHead=Linear2024.07 | 91.76 | — | — | — | — | — | — | — | — | — | — | |
| LayoutXLM_BASEHead=Linear, Model Size=BASE2024.07 | 89.24 | — | — | — | — | — | — | — | — | — | — | |
| ESPParameters=50M, Pretrain Data Size=0.9M2023.03 | 89.13 | — | — | — | — | — | — | — | — | — | — | |
| LiLT_BASEPretrain Data Size=11M2023.03 | 85.85 | — | — | — | — | — | — | — | — | — | — | |
| XYLayout_BASEParameters=345M + α, Pretrain Data Size=30M2023.03 | 82.04 | — | — | — | — | — | — | — | — | — | — | |
| ESPmultilingual model=false2023.03 | — | 90.3 | 81.1 | 85.4 | 90.5 | 88.9 | 87.2 | 87.5 | 87.3 | — | — | |
| LayoutXLMlanguage-specific fine-tuning=true2023.03 | — | 89.2 | 79.2 | 75.5 | 70.2 | 80.8 | 82.2 | 79 | 79.5 | — | — | |
| LiLTbackbone=InfoXLM2023.03 | — | 89.4 | 79.6 | 79.1 | 79.5 | 83.7 | 82.3 | 82.2 | 82.3 | — | — | |
| ROBERTa2023.03 | — | 87.7 | 77.6 | 61.1 | 67.4 | 66.9 | 68.1 | 68.2 | 71 | — | — |