OCR on ORB-Indic
0.251WERGemini-2.5 Flash
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Gemini-2.5 FlashRotation Condition=Ideal upright conditions2025.11 | 0.251 | 0.113 | — | — | |
| Gemini-2.5 FlashRotation Condition=w/o Rotation2025.11 | 0.262 | 0.117 | — | — | |
| Gemini-2.5 FlashRotation Condition=w/ Rotation2025.11 | 0.272 | 0.129 | — | — | |
| ChitrapathakRotation Condition=w/ Rotation2025.11 | 0.399 | 0.18 | — | — | |
| ChitrapathakRotation Condition=Ideal upright conditions2025.11 | 0.4 | 0.181 | — | — | |
| Gemini-2.5 ProRotation Condition=Ideal upright conditions2025.11 | 0.501 | 0.425 | — | — | |
| LLaMA-4 (Maverick) 17BRotation Condition=Ideal upright conditions2025.11 | 0.526 | 0.266 | — | — | |
| LLaMA-4 (Maverick) 17BRotation Condition=w/ Rotation2025.11 | 0.526 | 0.266 | — | — | |
| Gemini-2.5 ProRotation Condition=w/ Rotation2025.11 | 0.566 | 0.5 | — | — | |
| Gemini-2.5 ProRotation Condition=w/o Rotation2025.11 | 0.676 | 0.617 | — | — | |
| Gemma-3 27BRotation Condition=Ideal upright conditions2025.11 | 0.751 | 0.523 | — | — | |
| Gemma-3 27BRotation Condition=w/ Rotation2025.11 | 0.756 | 0.532 | — | — | |
| GPT-4oRotation Condition=w/ Rotation2025.11 | 0.886 | 0.813 | — | — | |
| GPT-4oRotation Condition=Ideal upright conditions2025.11 | 0.893 | 0.984 | — | — | |
| Gemma-3 27BRotation Condition=w/o Rotation2025.11 | 0.959 | 0.832 | — | — | |
| GPT-4oRotation Condition=w/o Rotation2025.11 | 0.98 | 0.955 | — | — | |
| LLaMA-4 (Maverick) 17BRotation Condition=w/o Rotation2025.11 | 1.164 | 0.965 | — | — | |
| ChitrapathakRotation Condition=w/o Rotation2025.11 | 2.913 | 1.746 | — | — | |
| Nanonets-OCR-sRotation Condition=Ideal upright conditions2025.11 | 4.059 | 3.704 | — | — | |
| Nanonets-OCR-sRotation Condition=w/ Rotation2025.11 | 4.059 | 3.704 | — | — | |
| Nanonets-OCR-sRotation Condition=w/o Rotation2025.11 | 14.262 | 10.389 | — | — | |
| ChitrapathakRotation Condition=Ideal upright conditions2025.11 | — | — | 66.1 | 62.1 | |
| ChitrapathakRotation Condition=w/o Rotation2025.11 | — | — | 19.7 | 17.7 | |
| ChitrapathakRotation Condition=w/ Rotation2025.11 | — | — | 66.1 | 62.1 | |
| Gemini-2.5 FlashRotation Condition=Ideal upright conditions2025.11 | — | — | 81 | 77 | |
| Gemini-2.5 FlashRotation Condition=w/o Rotation2025.11 | — | — | 79 | 75 | |
| Gemini-2.5 FlashRotation Condition=w/ Rotation2025.11 | — | — | 81 | 77 | |
| Gemini-2.5 ProRotation Condition=Ideal upright conditions2025.11 | — | — | 52.7 | 52.2 | |
| Gemini-2.5 ProRotation Condition=w/o Rotation2025.11 | — | — | 36.6 | 33 | |
| Gemini-2.5 ProRotation Condition=w/ Rotation2025.11 | — | — | 47.6 | 44 | |
| Gemma-3Parameters=27B, Rotation Condition=Ideal upright conditions2025.11 | — | — | 21.8 | 20.3 | |
| Gemma-3Parameters=27B, Rotation Condition=w/o Rotation2025.11 | — | — | 8.1 | 7.3 | |
| Gemma-3Parameters=27B, Rotation Condition=w/ Rotation2025.11 | — | — | 21.2 | 19.9 | |
| GPT-4oRotation Condition=Ideal upright conditions2025.11 | — | — | 11.9 | 10.6 | |
| GPT-4oRotation Condition=w/o Rotation2025.11 | — | — | 11.8 | 10.5 | |
| GPT-4oRotation Condition=w/ Rotation2025.11 | — | — | 13.4 | 11.9 | |
| LLaMA-4 (Maverick)Parameters=17B, Rotation Condition=Ideal upright conditions2025.11 | — | — | 48.9 | 46 | |
| LLaMA-4 (Maverick)Parameters=17B, Rotation Condition=w/o Rotation2025.11 | — | — | 16.4 | 14.7 | |
| LLaMA-4 (Maverick)Parameters=17B, Rotation Condition=w/ Rotation2025.11 | — | — | 48.9 | 46 | |
| Nanonets-OCR-sRotation Condition=Ideal upright conditions2025.11 | — | — | 26.6 | 23 | |
| Nanonets-OCR-sRotation Condition=w/o Rotation2025.11 | — | — | 21.1 | 18.8 | |
| Nanonets-OCR-sRotation Condition=w/ Rotation2025.11 | — | — | 26.6 | 23 |