Optical Character Recognition on SROIE P, EN
93.77F1 ScorePILOT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| PILOT2025.04 | 93.77 | 60.49 | 93.22 | |
| ViTLP2025.04 | 92.79 | — | — | |
| Nanonets-OCR-sEvaluation protocol=Reproduced2025.04 | 92.56 | 56.52 | 92.23 | |
| Qwen3-VL-4BEvaluation protocol=Reproduced2025.04 | 92.44 | 58.39 | 91.56 | |
| Qwen2.5-VL-7BEvaluation protocol=Reproduced2025.04 | 92.24 | 57.12 | 91.23 | |
| GPT-4oEvaluation protocol=Reproduced2025.04 | 92.04 | 58.32 | 91.65 | |
| OlmOCR-2-7BEvaluation protocol=Reproduced2025.04 | 90.73 | 54.37 | 89.74 | |
| GPT-4o-miniEvaluation protocol=Reproduced2025.04 | 89.96 | 53.68 | 88.62 | |
| PaddleOCR-VLEvaluation protocol=Reproduced2025.04 | 88.23 | 51.05 | 87.46 | |
| Claude-3-HaikuEvaluation protocol=Reproduced2025.04 | 84.52 | 40.42 | 81.33 | |
| Nanonets-OCR2-3BEvaluation protocol=Reproduced2025.04 | 76.3 | 43.65 | 79.17 | |
| InternVL2.5-8BEvaluation protocol=Reproduced2025.04 | 72.84 | 40.6 | 68.95 | |
| TesseractEvaluation protocol=Reproduced2025.04 | 67.77 | 7.19 | 67.99 | |
| EasyOCREvaluation protocol=Reproduced2025.04 | 61.21 | 1.47 | 58.24 | |
| Phi-3.5-VisionEvaluation protocol=Reproduced2025.04 | 57.46 | 37.26 | 53.11 |