Pair Extraction on RFUND-EN (test)
79.27F1 ScorePEneo
Evaluation results
| Method | Links | |
|---|---|---|
| PEneoBackbone=LayoutLMv3BASE, Pipeline=Joint2024.01 | 79.27 | |
| PEneoBackbone=LiLT[InfoXLM]BASE, Pipeline=Joint2024.01 | 74.29 | |
| PEneoBackbone=LayoutXLMBASE, Pipeline=Joint2024.01 | 74.25 | |
| PEneoBackbone=LiLT[EN-R]BASE, Pipeline=Joint2024.01 | 74.22 | |
| PEneoBackbone=LayoutLMv2BASE, Pipeline=Joint2024.01 | 71.97 | |
| GeoLayoutLMPipeline=SER+RE2024.01 | 69.03 | |
| LayoutLMv3BASEPipeline=SER+RE, Note=RE module re-implemented (†)2024.01 | 57.66 | |
| LiLT[EN-R]BASEPipeline=SER+RE2024.01 | 54.33 | |
| FUDGEPipeline=End-to-End, Note=adjusted metric (‡)2024.01 | 53.15 | |
| LayoutXLMBASEPipeline=SER+RE2024.01 | 52.98 | |
| LiLT[InfoXLM]BASEPipeline=SER+RE2024.01 | 52.18 | |
| TPP-LayoutLMv3BASEPipeline=Joint, Note=adjusted metric (‡)2024.01 | 50.27 | |
| LayoutLMv2BASEPipeline=SER+RE2024.01 | 49.06 | |
| GPT-4VPipeline=Image2Seq, OCR=true2024.01 | 38.15 | |
| DonutPipeline=Image2Seq2024.01 | 24.54 | |
| GPT-4VPipeline=Image2Seq, OCR=false2024.01 | 20.96 |