Document Information Extraction on Ticket 12 (test)
94.1F1 ScoreDonut
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DonutOCR-based=false, Number of parameters=143M, Inference time (s)=0.62021.11 | 94.1 | 98.7 | |
| LayoutLMv2OCR-based=true, Number of parameters=179M + alpha, Inference time (s)=1.82021.11 | 87.2 | 90.1 | |
| BERTOCR-based=true, Number of parameters=86M + alpha, Inference time (s)=1.72021.11 | 74.3 | 82.4 | |
| WYVERNOCR-based=true, Number of parameters=106M + alpha, Inference time (s)=1.52021.11 | 41.8 | 54.8 | |
| SPADEOCR-based=true, Number of parameters=93M + alpha, Inference time (s)=4.52021.11 | 14.9 | 29.4 |