Optical Character Recognition on ORB-En-SynthDog 4-class rotation
2.61Word Error Rate (WER)Nanonets-OCR-s
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Nanonets-OCR-sCondition=Ideal upright conditions2025.11 | 2.61 | 1.73 | |
| Nanonets-OCR-sCondition=w/ Rotation2025.11 | 2.61 | 1.73 | |
| Gemini-2.5 FlashCondition=Ideal upright conditions2025.11 | 22.43 | 15.33 | |
| Gemini-2.5 FlashCondition=w/ Rotation2025.11 | 22.43 | 15.33 | |
| Gemini-2.5 FlashCondition=w/o Rotation2025.11 | 26.24 | 18.66 | |
| LLaMA-4 (Maverick) 17BCondition=Ideal upright conditions2025.11 | 29.37 | 14.09 | |
| LLaMA-4 (Maverick) 17BCondition=w/ Rotation2025.11 | 29.37 | 14.09 | |
| Qwen-2.5-VLCondition=Ideal upright conditions2025.11 | 32.2 | 4.67 | |
| Qwen-2.5-VLCondition=w/ Rotation2025.11 | 34.98 | 7.77 | |
| Nanonets-OCR-sCondition=w/o Rotation2025.11 | 44.14 | 34.25 | |
| Qwen-2.5-VLCondition=w/o Rotation2025.11 | 55.1 | 33.65 | |
| docTRCondition=Ideal upright conditions2025.11 | 56.23 | 40.04 | |
| docTRCondition=w/ Rotation2025.11 | 56.23 | 40.04 | |
| Gemini-2.5 ProCondition=Ideal upright conditions2025.11 | 58.58 | 52.34 | |
| LLaMA-4 (Maverick) 17BCondition=w/o Rotation2025.11 | 59.91 | 41.75 | |
| Gemma-3 27BCondition=Ideal upright conditions2025.11 | 61.56 | 30.29 | |
| Gemma-3 27BCondition=w/ Rotation2025.11 | 61.56 | 30.29 | |
| Gemini-2.5 ProCondition=w/ Rotation2025.11 | 67.07 | 61.16 | |
| Gemini-2.5 ProCondition=w/o Rotation2025.11 | 70.96 | 65.41 | |
| Gemma-3 27BCondition=w/o Rotation2025.11 | 75.15 | 50.06 | |
| GPT-4oCondition=Ideal upright conditions2025.11 | 82.22 | 73.65 | |
| GPT-4oCondition=w/ Rotation2025.11 | 82.22 | 73.65 | |
| mPLUG-DocOwl2Condition=Ideal upright conditions2025.11 | 85.45 | 80.87 | |
| mPLUG-DocOwl2Condition=w/ Rotation2025.11 | 86.44 | 81.82 | |
| docTRCondition=w/o Rotation2025.11 | 88.03 | 69.07 | |
| GPT-4oCondition=w/o Rotation2025.11 | 92.35 | 82.08 | |
| mPLUG-DocOwl2Condition=w/o Rotation2025.11 | 93.35 | 87.55 |