Entity Recognition on CORD official (test)
98.94F1 ScoreUDoc
Evaluation Results
| Method | Links | |
|---|---|---|
| UDocParameters=272M, Modality=T+L+I (R), Image Embedding=ResNet-50, Not_Directly_Comparable=true2022.04 | 98.94 | |
| DocTr#params=153M2023.07 | 98.2 | |
| LayoutLMv3_LARGEParameters=368M, Modality=T+L+I (P), Image Embedding=Linear2022.04 | 97.46 | |
| BROS_LARGEParameters=340M, Modality=T+L, Image Embedding=None2022.04 | 97.4 | |
| BROS_LARGE#params=340M2023.07 | 97.3 | |
| FormNet#params=345M2023.07 | 97.3 | |
| FormNetParameters=345M, Modality=T+L, Image Embedding=None2022.04 | 97.28 | |
| DocFormer_LARGE#params=536M2023.07 | 97 | |
| DocFormer_LARGEParameters=536M, Modality=T+L+I (G), Image Embedding=ResNet-502022.04 | 96.99 | |
| UDoc*Pretraining Source=IIT-CDIP, Pretraining #Data=1M, Pretraining Scale=Region, Pretraining Max #Words=64x512, Pretraining Modality=V+L, #Param.=272M2022.04 | 96.86 | |
| UDocPretraining Source=IIT-CDIP, Pretraining #Data=1M, Pretraining Scale=Region, Pretraining Max #Words=64x512, Pretraining Modality=V+L, #Param.=272M2022.04 | 96.64 | |
| LayoutLMv3_BASEParameters=133M, Modality=T+L+I (P), Image Embedding=Linear2022.04 | 96.56 | |
| BROS_BASE#params=110M2023.07 | 96.5 | |
| TILT-LargePretraining Source=RVL-CDIP+, Pretraining #Data=1.1M, Pretraining Scale=Word, Pretraining Max #Words=512, Pretraining Modality=V+L, #Param.=780M2022.04 | 96.33 | |
| DocFormer_BASEParameters=183M, Modality=T+L+I (G), Image Embedding=ResNet-502022.04 | 96.33 | |
| TILT_LARGEParameters=780M, Modality=T+L+I (R), Image Embedding=U-Net2022.04 | 96.33 | |
| DocFormer_BASE#params=183M2023.07 | 96.3 | |
| LiLT_BASEModality=T+L, Image Embedding=None2022.04 | 96.07 | |
| LayoutLMv2-LargePretraining Source=IIT-CDIP, Pretraining #Data=11M, Pretraining Scale=Word, Pretraining Max #Words=512, Pretraining Modality=V+L, #Param.=426M2022.04 | 96.01 | |
| LayoutLMv2_LARGEParameters=426M, Modality=T+L+I (G), Image Embedding=ResNeXt101-FPN2022.04 | 96.01 | |
| LayoutLMv2_LARGE#params=426M2023.07 | 96 | |
| BROS_BASEParameters=110M, Modality=T+L, Image Embedding=None2022.04 | 95.73 | |
| TILT-BasePretraining Source=RVL-CDIP+, Pretraining #Data=1.1M, Pretraining Scale=Word, Pretraining Max #Words=512, Pretraining Modality=V+L, #Param.=230M2022.04 | 95.11 | |
| TILT_BASEParameters=230M, Modality=T+L+I (R), Image Embedding=U-Net2022.04 | 95.11 | |
| LayoutLMv2_BASE#params=200M2023.07 | 95 | |
| LayoutLM_LARGE#params=343M2023.07 | 95 | |
| LayoutLMv2-BasePretraining Source=IIT-CDIP, Pretraining #Data=11M, Pretraining Scale=Word, Pretraining Max #Words=512, Pretraining Modality=V+L, #Param.=200M2022.04 | 94.95 | |
| LayoutLMv2_BASEParameters=200M, Modality=T+L+I (G), Image Embedding=ResNeXt101-FPN2022.04 | 94.95 | |
| LayoutLM-LargePretraining Source=IIT-CDIP, Pretraining #Data=11M, Pretraining Scale=Word, Pretraining Max #Words=512, Pretraining Modality=L, #Param.=343M2022.04 | 94.93 | |
| LayoutLM-BasePretraining Source=IIT-CDIP, Pretraining #Data=11M, Pretraining Scale=Word, Pretraining Max #Words=512, Pretraining Modality=L, #Param.=113M2022.04 | 94.72 | |
| LayoutLM_BASE#params=113M2023.07 | 94.7 | |
| RoBERTa_LARGEParameters=355M, Modality=T, Image Embedding=None2022.04 | 93.8 | |
| RoBERTa_BASEParameters=125M, Modality=T, Image Embedding=None2022.04 | 93.54 | |
| BERT-LargePretraining Scale=Word, Pretraining Max #Words=512, Pretraining Modality=L, #Param.=340M2022.04 | 90.25 | |
| BERT_LARGEParameters=340M, Modality=T, Image Embedding=None2022.04 | 90.25 | |
| BERT-BasePretraining Scale=Word, Pretraining Max #Words=512, Pretraining Modality=L, #Param.=110M2022.04 | 89.68 | |
| BERT_BASEParameters=110M, Modality=T, Image Embedding=None2022.04 | 89.68 |