Multilingual Document Parsing on DocAtlas 1.0 (test)
5.5Text Edit DistanceDocAtlas-Deepseek
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| DocAtlas-DeepseekMethod Type=Expert VLMs, Params=3B2026.05 | 5.5 | 72.24 | 23.7 | — | 83.37 | |
| DotsOCRMethod Type=Expert VLMs, Params=3B2026.05 | 6.8 | 65.4 | 32.1 | — | 79.29 | |
| ChandraMethod Type=Expert VLMs, Params=9B2026.05 | 7.1 | 69.79 | 26.2 | — | 81.33 | |
| PaddleOCR-VLMethod Type=Expert VLMs, Params=1B2026.05 | 7.8 | 73.9 | 24.1 | — | 80.1 | |
| Qwen3-VLMethod Type=General VLMs, Params=3B2026.05 | 8.1 | 51.86 | 42 | — | 71.87 | |
| DeepseekOCRMethod Type=Expert VLMs, Params=3B2026.05 | 8.2 | 71.54 | 24.2 | — | 81.66 | |
| Nanonets-OCR-sMethod Type=Expert VLMs, Params=4B2026.05 | 8.8 | 71.9 | 51.8 | — | 81.53 | |
| Nanonets-OCR2Method Type=Expert VLMs, Params=3B2026.05 | 8.8 | 66.24 | 47.1 | — | 78.7 | |
| Gemini-2.0-ProMethod Type=General VLMs2026.05 | 9 | 68.5 | 35.6 | — | 79.75 | |
| InternVL3.5Method Type=General VLMs, Params=2B2026.05 | 9.5 | 70.8 | 54.3 | — | 77.2 | |
| MonkeyOCR-proMethod Type=Expert VLMs, Params=1.2B2026.05 | 9.5 | 72.8 | 29.5 | — | 78.25 | |
| Granite-DoclingMethod Type=Expert VLMs, Params=258M2026.05 | 11 | 42.32 | 61.5 | — | 56.11 | |
| GPT4oMethod Type=General VLMs2026.05 | 11.7 | 62.26 | 42.5 | — | 75.3 | |
| DolphinMethod Type=Expert VLMs, Params=400M2026.05 | 16 | 58.3 | 46.5 | — | 71.17 | |
| Qwen2.5-VLMethod Type=General VLMs, Params=2B2026.05 | 17.4 | 50.59 | 45.3 | — | 66.59 | |
| SmolDoclingMethod Type=Expert VLMs, Params=256M2026.05 | 20.1 | 37.25 | 70.6 | — | 58.55 | |
| MinerU2.5Method Type=Expert VLMs, Params=1.2B2026.05 | 26.7 | 72.79 | 27.3 | — | 73.07 |