Document Understanding on DUE-Benchmark (test)
84.7DocVQAUDOP
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| UDOPModality=V+T+L2022.12 | 84.7 | 47.4 | 82.8 | 28 | 85.5 | 47.2 | 78.9 | 64.8 | |
| StructuralLMlargeModality=T+L2022.12 | 83.9 | — | — | — | — | — | — | — | |
| LayoutLMv3largeModality=V+T+L2022.12 | 83.4 | 45.1 | 77.1 | 26.9 | 84 | 45.7 | 78.1 | 62.9 | |
| T5large+2D+UModality=T+L2022.12 | 81 | 46.1 | 75.9 | 26.8 | 83.3 | 43.3 | 78.6 | 59.8 | |
| LayoutLMv2largeModality=V+T+L2022.12 | 78.8 | — | — | — | — | — | — | — | |
| T5large+UModality=T2022.12 | 76.3 | 37.1 | 76 | 27.6 | 82.9 | 38.1 | 76 | 56.5 | |
| DonutModality=V2022.12 | 72.1 | — | — | — | — | — | — | — | |
| T5largeModality=T2022.12 | 70.4 | 36.7 | 74.3 | 25.3 | 74.4 | 33.3 | 58.9 | 50.7 | |
| T5large+2DModality=T+L2022.12 | 69.8 | 39.2 | 72.6 | 25.7 | 74 | 30.8 | 58 | 50.4 | |
| BERTlargeModality=T2022.12 | 67.5 | — | — | — | — | — | — | — | |
| LAMBERTModality=T+L2022.12 | — | — | 81.3 | — | — | — | — | — |