Entity Extraction on Kleister-NDA (val)
85.8Entity-level F1DocFormer-base (I+T+S)
Evaluation results
| Method | Links | |
|---|---|---|
| DocFormer-base (I+T+S)Input Modalities=image + text + spatial features, #param (M)=1832021.06 | 85.8 | |
| LayoutLMv2Model size=LARGE2020.12 | 85.2 | |
| LayoutLMv2-largeInput Modalities=image + text + spatial features, #param (M)=4262021.06 | 85.2 | |
| LayoutLMModel size=LARGE2020.12 | 83.4 | |
| LayoutLMv1-largeInput Modalities=text / (text + spatial) features, #param (M)=3432021.06 | 83.4 | |
| LayoutLMv2Model size=BASE2020.12 | 83.3 | |
| LayoutLMv2-baseInput Modalities=image + text + spatial features, #param (M)=2002021.06 | 83.3 | |
| LayoutLMModel size=BASE2020.12 | 82.7 | |
| LayoutLMv1-baseInput Modalities=text / (text + spatial) features, #param (M)=1132021.06 | 82.7 | |
| DocFormer-base (T+S)Input Modalities=image + text + spatial features, #param (M)=1492021.06 | 82.1 | |
| UniLMv2Model size=LARGE2020.12 | 81.8 | |
| UniLMv2-largeInput Modalities=text / (text + spatial) features, #param (M)=3552021.06 | 81.8 | |
| UniLMv2Model size=BASE2020.12 | 79.5 | |
| UniLMv2-baseInput Modalities=text / (text + spatial) features, #param (M)=1252021.06 | 79.5 | |
| RoBERTaModel size=BASE2020.12 | 79.3 | |
| BERTModel size=LARGE2020.12 | 79.1 | |
| BERT-largeInput Modalities=text / (text + spatial) features, #param (M)=3402021.06 | 79.1 | |
| BERTModel size=BASE2020.12 | 77.9 | |
| BERT-baseInput Modalities=text / (text + spatial) features, #param (M)=1102021.06 | 77.9 | |
| RoBERTaInput Modalities=text / (text + spatial) features, #param (M)=1252021.06 | 76.7 | |
| LAMBERTInput Modalities=text / (text + spatial) features2021.06 | 75.7 |