Multi-task Optical Character Recognition on OCRBench v2
67.1Average ScoreORCA (Qwen3VL-8B)
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| ORCA (Qwen3VL-8B)category=Multi-Agent Framework, backbone=Qwen3VL-8B2026.03 | 67.1 | 83.2 | 51.3 | 28.4 | 89.8 | 62.3 | 59.4 | 88.7 | 73.7 | |
| Qwen3-VL-8B-Instructcategory=Open-source LMM, reproduced_by_authors=false2026.03 | 65.4 | — | — | — | — | — | — | — | — | |
| ORCA (Qwen3VL-4B)category=Multi-Agent Framework, backbone=Qwen3VL-4B2026.03 | 64.8 | 81.1 | 48.2 | 24.3 | 89.3 | 60.1 | 57.2 | 86.6 | 71.6 | |
| Qwen3-VL-4B-Instructcategory=Open-source LMM, reproduced_by_authors=false2026.03 | 63.7 | — | — | — | — | — | — | — | — | |
| Qwen3-Omni-A3Bcategory=Open-source LMM, reproduced_by_authors=false2026.03 | 61.3 | 72.3 | 62 | 45.6 | 93.5 | 20.8 | 67 | 74.1 | 55.3 | |
| Nemotron Nano V2 VLcategory=Open-source LMM, reproduced_by_authors=false2026.03 | 61.2 | 67.6 | 54.5 | 36.2 | 92 | 26.6 | 80.4 | 75.5 | 57 | |
| Llama Nemotron VL 8Bcategory=Open-source LMM, reproduced_by_authors=false2026.03 | 60.2 | 70.2 | 69.1 | 61.8 | 81.4 | 39.2 | 31.9 | 73.1 | 54.7 | |
| InternVL-3-14Bcategory=Open-source LMM, reproduced_by_authors=false2026.03 | 52.6 | 67.3 | 36.9 | 11.2 | 89 | 38.4 | 38.4 | 79.2 | 60.5 | |
| ORCA (Qwen2.5-VL-7B)category=Multi-Agent Framework, backbone=Qwen2.5-VL-7B2026.03 | 50.3 | 72.3 | 28.6 | 3.4 | 84.7 | 34.2 | 41.9 | 75.8 | 61.5 | |
| Qwen2.5-VL-7Bcategory=Open-source LMM, reproduced_by_authors=false2026.03 | 46.7 | 68.8 | 25.7 | 1.2 | 80.2 | 30.4 | 38.2 | 73.2 | 56.2 | |
| Pixtral-12Bcategory=Open-source LMM, reproduced_by_authors=false2026.03 | 40.3 | 48.9 | 21.6 | 0 | 66.3 | 35.5 | 29.8 | 66.9 | 53.7 | |
| LLaVA-OV-7Bcategory=Open-source LMM, reproduced_by_authors=false2026.03 | 36.4 | 46 | 20.8 | 0.1 | 58.3 | 25.3 | 23.3 | 64.4 | 53 | |
| Cambrian-34Bcategory=Open-source LMM, reproduced_by_authors=false2026.03 | 34.7 | 45.3 | 21.5 | 0 | 53.6 | 19.2 | 19.5 | 63.5 | 55.5 | |
| Molmo-7Bcategory=Open-source LMM, reproduced_by_authors=false2026.03 | 34.5 | 52.4 | 21.3 | 0.1 | 45.5 | 7.6 | 28.5 | 65.3 | 55 | |
| LLaVA-Next-8Bcategory=Open-source LMM, reproduced_by_authors=false2026.03 | 31.5 | 41.3 | 18.8 | 0 | 49.5 | 21.2 | 17.3 | 55.2 | 48.9 | |
| TextMonkeycategory=Open-source LMM, reproduced_by_authors=false2026.03 | 23.9 | 39.1 | 0.7 | 0 | 19 | 12.2 | 19 | 61.1 | 40.2 |