Document Retrieval on OHR-Bench Retrieval
81.2Accuracy (Text)Ground Truth
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Ground TruthCategory=Ground Truth2025.05 | 81.2 | 69.6 | 74.8 | 70.3 | 9.8 | 70 | |
| DiT-Qwen2.5-VL-72BCategory=VLM for OCR, Layout Analysis=DiT2025.05 | 76.9 | 57.7 | 55.6 | 44.6 | 5.4 | 59.7 | |
| SCAN-Qwen2.5-VL-72BCategory=VLM for OCR, Layout Analysis=SCAN2025.05 | 75.7 | 56.6 | 57.3 | 40.6 | 6.5 | 58.9 | |
| Qwen2.5-VL-72BCategory=VLM for OCR2025.05 | 75.1 | 60 | 60 | 38.2 | 5.3 | 59.6 | |
| Beehive-Qwen2.5-VL-72BCategory=VLM for OCR, Layout Analysis=Beehive2025.05 | 73.3 | 16 | 42.3 | 16.3 | 6.1 | 42.6 | |
| olmOCR-7BCategory=VLM for OCR2025.05 | 72.5 | 58.4 | 55.4 | 24.8 | 5 | 56.6 | |
| InternVL2.5-78BCategory=VLM for OCR2025.05 | 68.6 | 57.9 | 55.6 | 45.1 | 2.7 | 56.2 | |
| SCAN-GOT-580MCategory=OCR-specialized small VLM, Layout Analysis=SCAN2025.05 | 68.5 | 54.3 | 50.7 | 36.6 | 5.3 | 53.9 | |
| DiT-GOT-580MCategory=OCR-specialized small VLM, Layout Analysis=DiT2025.05 | 67.5 | 50.3 | 47.7 | 35.4 | 4.6 | 51.9 | |
| Beehive-GOT-580MCategory=OCR-specialized small VLM, Layout Analysis=Beehive2025.05 | 65.2 | 49.5 | 48.7 | 39 | 4.7 | 51.2 | |
| DocLayout-YOLO-Qwen2.5-VL-72BCategory=VLM for OCR, Layout Analysis=DocLayout-YOLO2025.05 | 63.5 | 12.4 | 36 | 11.7 | 5.4 | 36.3 | |
| GOT-580MCategory=OCR-specialized small VLM2025.05 | 62.1 | 41 | 48.7 | 17.4 | 3.7 | 45.4 | |
| DocLayout-YOLO-GOT-580MCategory=OCR-specialized small VLM, Layout Analysis=DocLayout-YOLO2025.05 | 60.4 | 45.5 | 43.2 | 32.8 | 4.4 | 46.8 | |
| Nougat-350MCategory=OCR-specialized small VLM2025.05 | 59.1 | 32.7 | 44.2 | 11.3 | 4.4 | 40.9 |