Relationship Extraction on RFUND Multilingual (test)
85.05ZH ScorePEneo-LayoutLMv3
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| PEneo-LayoutLMv3Model variant=Chinese BASE, Backbone=LayoutLMv32024.01 | 85.05 | — | — | — | — | — | — | |
| PEneo-LiLT [InfoXLM]Model variant=BASE, Backbone=LiLT [InfoXLM]2024.01 | 80.51 | 54.59 | 71.43 | 77.49 | 73.62 | 70.11 | 71.43 | |
| PEneo-LayoutXLMModel variant=BASE, Backbone=LayoutXLM2024.01 | 80.41 | 52.81 | 74.56 | 78.11 | 75.17 | 74.06 | 70.81 | |
| LayoutLMv3Model variant=Chinese BASE2024.01 | 72.14 | — | — | — | — | — | — | |
| LiLT [InfoXLM]Model variant=BASE2024.01 | 66.5 | 43.98 | 63.85 | 62.6 | 60.57 | 55.13 | 52.96 | |
| LayoutXLMModel variant=BASE2024.01 | 64.11 | 40.21 | 66.75 | 67.98 | 63.04 | 58.77 | 59.79 | |
| DonutModel variant=BASE2024.01 | 28.21 | 13.82 | — | — | — | — | — |