Relation Extraction on XFUND
84.71ZH ScoreLiLT[InfoXLM] BASE
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| LiLT[InfoXLM] BASEMultitask fine-tuning=true, Pre-training Docs Language=English only, Pre-training Docs Size=11M2022.02 | 84.71 | 83.45 | 83.35 | 84.66 | 84.58 | 78.78 | 76.43 | 81.25 | |
| LayoutXLM_BASEMultitask fine-tuning=true, Pre-training Docs Language=Multilingual, Pre-training Docs Size=30M2022.02 | 82.41 | 81.42 | 81.04 | 82.21 | 83.1 | 78.54 | 70.44 | 78.23 | |
| LiLT[InfoXLM]-BASEPre-training Data Language=English only, Pre-training Docs Size=11M, Evaluation Protocol=fine-tuning on X, testing on X2022.02 | 72.97 | 70.37 | 71.95 | 69.65 | 70.43 | 65.58 | 58.74 | 67.81 | |
| LayoutXLM-BASEPre-training Data Language=Multilingual, Pre-training Docs Size=30M, Evaluation Protocol=fine-tuning on X, testing on X2022.02 | 70.73 | 69.63 | 68.96 | 63.53 | 64.15 | 65.51 | 57.18 | 64.32 | |
| XLM-R_BASEMultitask fine-tuning=true2022.02 | 67.97 | 68.29 | 68.28 | 67.27 | 69.37 | 68.87 | 60.82 | 63.41 | |
| InfoXLM_BASEMultitask fine-tuning=true2022.02 | 64.93 | 64.73 | 68.28 | 68.31 | 66.9 | 63.84 | 57.63 | 61.45 | |
| InfoXLM-BASEPre-training Data Language=-, Pre-training Docs Size=-, Evaluation Protocol=fine-tuning on X, testing on X2022.02 | 52.14 | 60 | 55.16 | 49.13 | 52.81 | 52.62 | 41.7 | 49.1 | |
| XLM-RoBERTa-BASEPre-training Data Language=-, Pre-training Docs Size=-, Evaluation Protocol=fine-tuning on X, testing on X2022.02 | 51.05 | 58 | 52.95 | 49.65 | 53.05 | 50.41 | 39.82 | 47.69 | |
| LiLT [InfoXLM] BASEPre-training Docs Language=English only, Pre-training Docs Size=11M, Evaluation Protocol=Cross-lingual zero-shot transfer2022.02 | 47.64 | 50.81 | 49.68 | 52.09 | 46.97 | 41.69 | 42.72 | 49.3 | |
| LayoutXLM_BASEPre-training Docs Language=Multilingual, Pre-training Docs Size=30M, Evaluation Protocol=Cross-lingual zero-shot transfer2022.02 | 44.94 | 44.08 | 47.08 | 44.16 | 40.9 | 38.2 | 36.85 | 43.88 | |
| InfoXLM_BASEEvaluation Protocol=Cross-lingual zero-shot transfer2022.02 | 24.05 | 28.51 | 24.81 | 24.54 | 21.93 | 20.27 | 20.49 | 24.23 | |
| XLM-R_BASEEvaluation Protocol=Cross-lingual zero-shot transfer2022.02 | 16.01 | 26.11 | 24.4 | 22.4 | 23.74 | 22.88 | 19.96 | 22.76 |