Semantic Entity Recognition on CORD
98.6F1 ScoreLayoutLLM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LayoutLLMParams=6914.38M, Flops=8654.62G2024.07 | 98.6 | — | — | |
| RORE-GeoLayoutLM#Params=399M+242024.09 | 98.52 | — | — | |
| DocTr#Params=153M2024.09 | 98.2 | — | — | |
| GeoLayoutLM#Params=399M, reproduced=true2024.09 | 98.11 | — | — | |
| ROAP-LayoutLMv3Modalities=T+L+I (P)2026.01 | 97.99 | 97.96 | 98.01 | |
| GraphLayoutLM#Params=372M, reproduced=true2024.09 | 97.98 | — | — | |
| GeoLayoutLM#Params=399M2023.04 | 97.97 | — | — | |
| Bi-VLDoc#Params=409M2024.09 | 97.84 | — | — | |
| HGALayoutLM_LARGEParams=307.7M, Flops=218.95G2024.07 | 97.7 | — | — | |
| LayoutLMv3_LARGE#Params=357M2023.04 | 97.46 | — | — | |
| mmLayout#Params=large2024.09 | 97.38 | — | — | |
| RORE-LayoutLMv3#Params=368M+242024.09 | 97.29 | — | — | |
| BROS_LARGE#Params=340M2023.04 | 97.28 | — | — | |
| BROS#Params=340M2024.09 | 97.28 | — | — | |
| FormNet#Params=large2024.09 | 97.28 | — | — | |
| FormNetModalities=T+L2026.01 | 97.28 | 98.02 | 96.55 | |
| Wukong-Reader#Params=470M2024.09 | 97.27 | — | — | |
| ERNIE-Layout#Params=large2024.09 | 97.21 | — | — | |
| LayoutMask#Params=404M2024.09 | 97.19 | — | — | |
| LAGaBi#Params=133M2024.09 | 97.05 | — | — | |
| ROAP-GeoLayoutLModalities=T+L+I (R)2026.01 | 97.05 | 96.94 | 97.16 | |
| DocReL#Params=142M2024.09 | 97 | — | — | |
| DocFormer#Params=502M2024.09 | 96.99 | — | — | |
| LayoutLMv3#Params=368M, reproduced=true2024.09 | 96.98 | — | — | |
| GraphDoc#Params=265M2024.09 | 96.93 | — | — | |
| DocGraphLM#Params=base2024.09 | 96.93 | — | — | |
| LayoutLMv3Modalities=T+L+I (P), reproduced by us=true2026.01 | 96.73 | 96.56 | 96.9 | |
| RORE-LayoutLMv3#Params=133M+122024.09 | 96.72 | — | — | |
| BROSModalities=T+L2026.01 | 96.5 | — | — | |
| GeoLayoutLMModalities=T+L+I (R), reproduced by us=true2026.01 | 96.34 | 96.19 | 96.48 | |
| DocFormer_BASELanguage-specific fine-tuning=true2022.02 | 96.33 | 96.52 | 96.14 | |
| DocFormerModalities=T+L+I (G)2026.01 | 96.33 | 96.52 | 96.14 | |
| ROAP-LiLTModalities=T+L2026.01 | 96.19 | 96.12 | 96.26 | |
| LiLTModalities=T+L, reproduced by us=true2026.01 | 96.09 | 96.2 | 95.97 | |
| LiLT[EN-R]_BASELanguage-specific fine-tuning=true2022.02 | 96.07 | 95.98 | 96.16 | |
| LiLT#Params=base2024.09 | 96.07 | — | — | |
| LayoutLMv2_LARGE#Params=426M2023.04 | 96.01 | — | — | |
| LayoutLMv3#Params=133M, reproduced=true2024.09 | 95.91 | — | — | |
| LiLT[InfoXLM]_BASELanguage-specific fine-tuning=true, Multilingual=true2022.02 | 95.77 | 95.74 | 95.81 | |
| ESP#Params=50M, supervised_pretrained=true2024.09 | 95.65 | — | — | |
| BROS_BASELanguage-specific fine-tuning=true2022.02 | 95.36 | 95.58 | 95.14 | |
| TILT_BASELanguage-specific fine-tuning=true2022.02 | 95.11 | — | — | |
| LayoutLMv2_BASELanguage-specific fine-tuning=true2022.02 | 94.95 | 94.53 | 95.39 | |
| LayoutLMv2Modalities=T+L+I (G)2026.01 | 94.95 | 94.53 | 95.39 | |
| LayoutLM_LARGE#Params=343M2023.04 | 94.93 | — | — | |
| LayoutXLM_BASELanguage-specific fine-tuning=true, Multilingual=true2022.02 | 94.81 | 94.56 | 95.06 | |
| LayoutXLMModalities=T+L+I (G)2026.01 | 94.81 | 94.56 | 95.06 | |
| LayoutLM_BASELanguage-specific fine-tuning=true2022.02 | 94.72 | 94.37 | 95.08 | |
| LayoutLMModalities=T+L+I (R)2026.01 | 94.72 | 94.37 | 95.08 | |
| LAMBERT_BASELanguage-specific fine-tuning=true2022.02 | 94.41 | — | — | |
| RoBERTaModalities=T2026.01 | 93.54 | — | — | |
| UniLMv2_BASELanguage-specific fine-tuning=true2022.02 | 90.92 | 89.87 | 91.98 | |
| BERT_LARGE#Params=340M2023.04 | 90.25 | — | — | |
| BERT_BASELanguage-specific fine-tuning=true2022.02 | 89.68 | 88.33 | 91.07 | |
| BERTModalities=T2026.01 | 89.68 | 88.33 | 91.07 |