Document Understanding on OmniDocBench standard (test)
93.75Overall ScoreDocHumming
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| DocHummingModelType=Ours, Size=1B2026.03 | 93.75 | 0.035 | 93.27 | 91.49 | 0.041 | |
| PaddleOCR-VLModelType=Specialized MLLMs (Modular), Size=0.9B2026.03 | 91.93 | 0.039 | 88.67 | 91.01 | 0.043 | |
| MinerU2.5ModelType=Specialized MLLMs (Modular), Size=1.2B2026.03 | 90.67 | 0.047 | 88.46 | 88.22 | 0.044 | |
| Qwen3-VL-235BModelType=General MLLMs, Size=235B2026.03 | 89.15 | 0.069 | 88.14 | 86.21 | 0.068 | |
| MonkeyOCR-pro-3BModelType=Specialized MLLMs (Modular), Size=3B2026.03 | 88.85 | 0.075 | 87.25 | 86.78 | 0.128 | |
| dots.ocrModelType=Specialized MLLMs (End2End), Size=3B2026.03 | 88.41 | 0.048 | 83.22 | 86.78 | 0.053 | |
| Gemini-2.5 ProModelType=General MLLMs, Size=-2026.03 | 88.03 | 0.075 | 85.82 | 85.71 | 0.097 | |
| Qwen2.5-VLModelType=General MLLMs, Size=72B2026.03 | 87.02 | 0.094 | 88.27 | 82.15 | 0.102 | |
| Deepseek-OCRModelType=Specialized MLLMs (End2End), Size=3B2026.03 | 87.01 | 0.073 | 83.37 | 84.97 | 0.086 | |
| PP-StructureV3ModelType=Pipeline Tools, Size=-2026.03 | 86.73 | 0.073 | 85.79 | 81.68 | 0.073 | |
| Dolphin-1.5ModelType=Specialized MLLMs (Modular), Size=0.3B2026.03 | 83.21 | 0.092 | 80.78 | 78.06 | 0.124 | |
| InternVL3.5ModelType=General MLLMs, Size=241B2026.03 | 82.67 | 0.142 | 87.23 | 75 | 0.125 | |
| olmOCRModelType=Specialized MLLMs (End2End), Size=7B2026.03 | 81.79 | 0.096 | 86.04 | 68.92 | 0.121 | |
| POINTS-ReaderModelType=Specialized MLLMs (End2End), Size=3B2026.03 | 80.98 | 0.134 | 79.2 | 77.13 | 0.145 | |
| InternVL3ModelType=General MLLMs, Size=78B2026.03 | 80.33 | 0.131 | 83.42 | 70.64 | 0.113 | |
| Mistral OCRModelType=Specialized MLLMs (End2End), Size=-2026.03 | 78.83 | 0.164 | 82.84 | 70.03 | 0.144 | |
| Mineru2-pipelineModelType=Pipeline Tools, Size=-2026.03 | 75.51 | 0.209 | 76.55 | 70.9 | 0.225 | |
| GPT-4oModelType=General MLLMs, Size=-2026.03 | 75.02 | 0.217 | 79.7 | 67.07 | 0.148 | |
| Marker-1.8.2ModelType=Pipeline Tools, Size=-2026.03 | 71.3 | 0.206 | 76.66 | 57.88 | 0.25 |