Optical Character Recognition on Ancient Yi (test)
90.53AccuracyRolmOCR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RolmOCREvaluation Protocol=Full Fine-tune2026.02 | 90.53 | 90.05 | 90.58 | |
| OmniOCREvaluation Protocol=Dynamic LoRA adaptation2026.02 | 89.62 | 90.14 | 89.6 | |
| RolmOCREvaluation Protocol=Fine-tuning (LoRA)2026.02 | 82.43 | 83.11 | 83.06 | |
| Claude-3.7-SonnetEvaluation Protocol=Zero-Shot2026.02 | 23.57 | 22.69 | 22.89 | |
| DeepSeek-VL2Evaluation Protocol=Zero-Shot2026.02 | 22.58 | 18.32 | 20.21 | |
| Doubao-1.5-Vision-ProEvaluation Protocol=Zero-Shot2026.02 | 22.34 | 21.23 | 21.51 | |
| RolmOCREvaluation Protocol=Zero-Shot2026.02 | 22.12 | 21.48 | 21.83 | |
| Qwen-VL-MaxEvaluation Protocol=Zero-Shot2026.02 | 21.23 | 20.47 | 20.73 | |
| Gemini 2.5 ProEvaluation Protocol=Zero-Shot2026.02 | 20.57 | 19.66 | 19.88 | |
| Pixtral LargeEvaluation Protocol=Zero-Shot2026.02 | 20.13 | 25.78 | 22.73 | |
| GLM-4v-PlusEvaluation Protocol=Zero-Shot2026.02 | 19.83 | 18.92 | 19.16 | |
| Kimi-VLEvaluation Protocol=Zero-Shot2026.02 | 19.32 | 20.14 | 19.92 | |
| InternVL3-78BEvaluation Protocol=Zero-Shot2026.02 | 19.26 | 21.04 | 20.12 | |
| GPT-4oEvaluation Protocol=Zero-Shot2026.02 | 18.91 | 20.43 | 19.65 | |
| Moonshot-v1Evaluation Protocol=Zero-Shot2026.02 | 17.14 | 18.75 | 17.92 | |
| Qwen-VL-OCREvaluation Protocol=Zero-Shot2026.02 | 14.53 | 15.31 | 15.1 |