Optical Character Recognition on IndicVisionBench OCR
55.51Bengali Word ANLSGPT-4o
Evaluation results
| Method | Links | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GPT-4o2026.02 | 55.51 | 32.68 | 54.62 | 35.54 | 94.33 | 69.79 | 94.67 | 78.47 | 63.44 | 37.93 | 94.61 | 73.46 | 68.88 | 40.71 | 74.35 | 43.39 | 95.97 | 70.08 | |
| Gemma-3 27BParameters=27B2026.02 | 42.15 | 24.41 | 46.47 | 29.5 | 84.22 | 54.24 | 92.06 | 72.64 | 50.4 | 31.06 | 92.67 | 70.72 | 70.88 | 42.65 | 39.52 | 16.51 | 86.76 | 54.14 | |
| LLaMA-4Parameters=17B2026.02 | 31.52 | 13.21 | 25.73 | 11.91 | 36.9 | 11.17 | 75.5 | 45.75 | 20.94 | 8.05 | 97.51 | 86.78 | 29.77 | 12.68 | 31.36 | 10.79 | 57.07 | 18.72 | |
| Surya OCR2026.02 | 28.76 | 12.61 | 20.11 | 8.38 | 24.4 | 6.37 | 73.46 | 36.37 | 13.41 | 4.33 | 52.7 | 25.58 | 18 | 7.31 | 25.75 | 7.71 | 51.72 | 16.85 | |
| Nanonets-OCR2-3BParameters=3B2026.02 | 28.56 | 12.42 | 32.26 | 16.78 | 99.38 | 93.07 | 97.24 | 89.81 | 40.97 | 15.92 | 99.82 | 97.11 | 98.7 | 82.84 | 95.25 | 78.83 | 99.42 | 89.39 | |
| Chitrapathak-12026.02 | 17.14 | 7.03 | 25.55 | 13.74 | 26.24 | 8.78 | 71.97 | 48.19 | 15.68 | 6.09 | 50.72 | 31.62 | 17.7 | 7.87 | 19.25 | 5.81 | 38.79 | 11 | |
| Chitrapathak-22026.02 | 14.51 | 5.47 | 19.87 | 8.36 | 18.8 | 4.81 | 64.47 | 34.7 | 9.82 | 2.27 | 44.74 | 21.83 | 15.24 | 7.06 | 17.66 | 5.68 | 31.81 | 6.69 | |
| Gemini-2.5 Flash2026.02 | 11.3 | 4.04 | 16.01 | 5.88 | 17.18 | 4.38 | 59.64 | 30.6 | 8.06 | 1.79 | 41.7 | 18.6 | 14.56 | 4.98 | 15.26 | 3.01 | 33.32 | 7.16 |