OCR on ORB En-SynthDog
0.17WERNanonets-OCR-s
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Nanonets-OCR-sRotation Condition=Ideal upright conditions2025.11 | 0.17 | 0.162 | — | — | |
| Nanonets-OCR-sRotation Condition=w/ Rotation2025.11 | 0.17 | 0.162 | — | — | |
| Gemini-2.5 FlashRotation Condition=Ideal upright conditions2025.11 | 0.23 | 0.146 | — | — | |
| Gemini-2.5 FlashRotation Condition=w/ Rotation2025.11 | 0.23 | 0.146 | — | — | |
| Gemini-2.5 FlashRotation Condition=w/o Rotation2025.11 | 0.267 | 0.179 | — | — | |
| LLaMA-4 (Maverick) 17BRotation Condition=Ideal upright conditions2025.11 | 0.296 | 0.152 | — | — | |
| LLaMA-4 (Maverick) 17BRotation Condition=w/ Rotation2025.11 | 0.296 | 0.152 | — | — | |
| docTRRotation Condition=Ideal upright conditions2025.11 | 0.583 | 0.411 | — | — | |
| docTRRotation Condition=w/ Rotation2025.11 | 0.583 | 0.411 | — | — | |
| Gemma-3 27BRotation Condition=Ideal upright conditions2025.11 | 0.605 | 0.317 | — | — | |
| Gemma-3 27BRotation Condition=w/ Rotation2025.11 | 0.605 | 0.317 | — | — | |
| Gemini-2.5 ProRotation Condition=Ideal upright conditions2025.11 | 0.636 | 0.595 | — | — | |
| Gemini-2.5 ProRotation Condition=w/ Rotation2025.11 | 0.724 | 0.677 | — | — | |
| Gemini-2.5 ProRotation Condition=w/o Rotation2025.11 | 0.753 | 0.705 | — | — | |
| Gemma-3 27BRotation Condition=w/o Rotation2025.11 | 0.754 | 0.531 | — | — | |
| GPT-4oRotation Condition=Ideal upright conditions2025.11 | 0.84 | 0.786 | — | — | |
| GPT-4oRotation Condition=w/ Rotation2025.11 | 0.84 | 0.786 | — | — | |
| docTRRotation Condition=w/o Rotation2025.11 | 0.896 | 0.694 | — | — | |
| GPT-4oRotation Condition=w/o Rotation2025.11 | 0.936 | 0.852 | — | — | |
| LLaMA-4 (Maverick) 17BRotation Condition=w/o Rotation2025.11 | 1.062 | 0.88 | — | — | |
| Nanonets-OCR-sRotation Condition=w/o Rotation2025.11 | 4.554 | 4.448 | — | — | |
| docTRRotation Condition=Ideal upright conditions2025.11 | — | — | 49.6 | 44.1 | |
| docTRRotation Condition=w/o Rotation2025.11 | — | — | 19.7 | 16 | |
| docTRRotation Condition=w/ Rotation2025.11 | — | — | 49.6 | 44.1 | |
| Gemini-2.5 FlashRotation Condition=Ideal upright conditions2025.11 | — | — | 83.5 | 67.8 | |
| Gemini-2.5 FlashRotation Condition=w/o Rotation2025.11 | — | — | 79.2 | 64.6 | |
| Gemini-2.5 FlashRotation Condition=w/ Rotation2025.11 | — | — | 83.5 | 67.8 | |
| Gemini-2.5 ProRotation Condition=Ideal upright conditions2025.11 | — | — | 46.2 | 39.1 | |
| Gemini-2.5 ProRotation Condition=w/o Rotation2025.11 | — | — | 32.8 | 28.4 | |
| Gemini-2.5 ProRotation Condition=w/ Rotation2025.11 | — | — | 36.3 | 31.4 | |
| Gemma-3Parameters=27B, Rotation Condition=Ideal upright conditions2025.11 | — | — | 56.7 | 57.3 | |
| Gemma-3Parameters=27B, Rotation Condition=w/o Rotation2025.11 | — | — | 36.1 | 36.3 | |
| Gemma-3Parameters=27B, Rotation Condition=w/ Rotation2025.11 | — | — | 56.7 | 57.2 | |
| GPT-4oRotation Condition=Ideal upright conditions2025.11 | — | — | 25.2 | 21.6 | |
| GPT-4oRotation Condition=w/o Rotation2025.11 | — | — | 16.2 | 15.3 | |
| GPT-4oRotation Condition=w/ Rotation2025.11 | — | — | 25.2 | 21.6 | |
| LLaMA-4 (Maverick)Parameters=17B, Rotation Condition=Ideal upright conditions2025.11 | — | — | 81.6 | 73.5 | |
| LLaMA-4 (Maverick)Parameters=17B, Rotation Condition=w/o Rotation2025.11 | — | — | 45 | 41.4 | |
| LLaMA-4 (Maverick)Parameters=17B, Rotation Condition=w/ Rotation2025.11 | — | — | 81.6 | 73.5 | |
| Nanonets-OCR-sRotation Condition=Ideal upright conditions2025.11 | — | — | 98.6 | 77 | |
| Nanonets-OCR-sRotation Condition=w/o Rotation2025.11 | — | — | 61.2 | 49.6 | |
| Nanonets-OCR-sRotation Condition=w/ Rotation2025.11 | — | — | 98.6 | 77 |