Semantic Entity Recognition on XFUND v1.0 (test)
82.25FUNSD ScoreLayoutXLM
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| LayoutXLMModel Size=LARGE, Fine-tuning Strategy=Language-specific2021.04 | 82.25 | 91.61 | 80.33 | 78.3 | 80.98 | 82.75 | 83.61 | 82.73 | 82.82 | |
| LayoutXLMmodel_size=LARGE, zero_shot_transfer=true, fine_tune_source=FUNSD2021.04 | 82.25 | 68.96 | 51.9 | 49.76 | 61.35 | 55.17 | 59.05 | 60.77 | 61.15 | |
| LayoutXLMModel Size=BASE, Fine-tuning Strategy=Language-specific2021.04 | 79.4 | 89.24 | 79.21 | 75.5 | 79.02 | 80.82 | 82.22 | 79.03 | 80.56 | |
| LayoutXLMmodel_size=BASE, zero_shot_transfer=true, fine_tune_source=FUNSD2021.04 | 79.4 | 60.19 | 47.15 | 45.65 | 57.57 | 48.46 | 52.52 | 53.9 | 55.61 | |
| InfoXLMModel Size=LARGE, Fine-tuning Strategy=Language-specific2021.04 | 73.25 | 89.55 | 79.04 | 67.4 | 71.4 | 71.52 | 73.38 | 72.12 | 74.71 | |
| InfoXLMmodel_size=LARGE, zero_shot_transfer=true, fine_tune_source=FUNSD2021.04 | 73.25 | 55.36 | 41.32 | 36.89 | 49.09 | 35.98 | 43.63 | 51.26 | 48.35 | |
| XLM-RoBERTaModel Size=LARGE, Fine-tuning Strategy=Language-specific2021.04 | 70.74 | 89.25 | 78.17 | 65.15 | 71.7 | 71.39 | 71.1 | 72.41 | 73.74 | |
| XLM-RoBERTamodel_size=LARGE, zero_shot_transfer=true, fine_tune_source=FUNSD2021.04 | 70.74 | 52.05 | 39.39 | 36.27 | 46.72 | 33.98 | 41.8 | 49.97 | 46.37 | |
| InfoXLMModel Size=BASE, Fine-tuning Strategy=Language-specific2021.04 | 68.52 | 88.68 | 78.65 | 62.3 | 70.15 | 67.51 | 70.63 | 70.08 | 72.07 | |
| InfoXLMmodel_size=BASE, zero_shot_transfer=true, fine_tune_source=FUNSD2021.04 | 68.52 | 44.08 | 36.03 | 31.02 | 40.21 | 28.8 | 35.87 | 45.02 | 41.19 | |
| XLM-RoBERTaModel Size=BASE, Fine-tuning Strategy=Language-specific2021.04 | 66.7 | 87.74 | 77.61 | 61.05 | 67.43 | 66.87 | 68.14 | 68.18 | 70.47 | |
| XLM-RoBERTamodel_size=BASE, zero_shot_transfer=true, fine_tune_source=FUNSD2021.04 | 66.7 | 41.44 | 30.23 | 30.55 | 37.1 | 27.67 | 32.86 | 39.36 | 38.24 |