Information Extraction on SROIE v1 (test)
95.24PrecisionLayoutLM_LARGE
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| LayoutLM_LARGEModality=Text + Layout (MVLM), Pre-training=11M, 1 epoch, Parameters=343M2019.12 | 95.24 | 95.24 | 95.24 | |
| LayoutLM_BASEModality=Text + Layout + Image (MVLM), Pre-training=11M, 2 epochs, Parameters=160M2019.12 | 94.67 | 94.67 | 94.67 | |
| LayoutLM_BASEModality=Text + Layout (MVLM + MDC), Pre-training=11M, 1 epoch, Parameters=113M2019.12 | 94.6 | 94.6 | 94.6 | |
| LayoutLM_BASEModality=Text + Layout (MVLM), Pre-training=11M, 2 epochs, Parameters=113M2019.12 | 94.38 | 94.38 | 94.38 | |
| LayoutLM_BASEModality=Text + Layout (MVLM), Pre-training=2M, 6 epochs, Parameters=113M2019.12 | 94.31 | 94.31 | 94.31 | |
| LayoutLM_LARGEModality=Text + Layout (MVLM), Pre-training=1M, 6 epochs, Parameters=343M2019.12 | 94.16 | 94.16 | 94.16 | |
| LayoutLM_BASEModality=Text + Layout + Image (MVLM), Pre-training=1M, 6 epochs, Parameters=160M2019.12 | 94.16 | 94.16 | 94.16 | |
| LayoutLM_BASEModality=Text + Layout (MVLM + MDC), Pre-training=1M, 6 epochs, Parameters=113M2019.12 | 94.02 | 94.02 | 94.02 | |
| Ranking 1st in SROIEModality=Baseline2019.12 | 94.02 | 94.02 | 94.02 | |
| LayoutLM_BASEModality=Text + Layout (MVLM), Pre-training=500K, 6 epochs, Parameters=113M2019.12 | 93.88 | 93.88 | 93.88 | |
| LayoutLM_BASEModality=Text + Layout (MVLM), Pre-training=1M, 6 epochs, Parameters=113M2019.12 | 93.8 | 93.8 | 93.8 | |
| RoBERTa_LARGEModality=Text only, Parameters=355M2019.12 | 92.8 | 92.8 | 92.8 | |
| BERT_LARGEModality=Text only, Parameters=340M2019.12 | 92 | 92 | 92 | |
| RoBERTa_BASEModality=Text only, Parameters=125M2019.12 | 91.07 | 91.07 | 91.07 | |
| BERT_BASEModality=Text only, Parameters=110M2019.12 | 90.99 | 90.99 | 90.99 |