Optical Character Recognition on Bentham (test)
8.48CEROCR+PAGEN
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| OCR+PAGENBase Model=GEMINI2025.02 | 8.48 | 13.7 | 2.63 | 2.77 | 8.3 | 871 | 1,269 | 825 | |
| OCR+PAGE1Base Model=GEMINI2025.02 | 8.56 | 13.55 | 2.63 | 2.64 | 8.28 | 871 | 1,244 | 827 | |
| OCR+IMAGESBase Model=GEMINI2025.02 | 8.67 | 15.32 | 2.63 | 4.75 | 7.95 | 2,287 | 1,509 | 794 | |
| OCR+PAGENBase Model=GPT-4O2025.02 | 8.87 | 16.37 | 2.63 | 6.13 | 7.61 | 1,105 | 1,213 | 757 | |
| OCR+IMAGESBase Model=GPT-4O2025.02 | 9.35 | 20.93 | 2.63 | 11.01 | 7.3 | 2,931 | 1,472 | 729 | |
| OCRBase Model=GEMINI2025.02 | 9.54 | 12.03 | 2.63 | 1.71 | 7.7 | 0 | 1,367 | 769 | |
| IMAGESBase Model=GEMINI2025.02 | 9.74 | 11.64 | 0 | 3.65 | 7.99 | 2,287 | 635 | 798 | |
| IMAGESBase Model=GPT-4O2025.02 | 9.87 | 16.58 | 0 | 8.88 | 7.69 | 2,902 | 619 | 769 | |
| IMAGES-ALL-AT-ONCEBase Model=GEMINI2025.02 | 9.88 | 11.7 | 0 | 3.19 | 8.51 | 2,287 | 262 | 851 | |
| OCRBase Model=GPT-4O2025.02 | 9.97 | 13.63 | 2.63 | 3.42 | 7.58 | 29 | 1,338 | 758 | |
| OCR+IMAGESBase Model=GEMMA2025.02 | 9.98 | 3.28 | 2.63 | 0.27 | 0.39 | 2,287 | 1,509 | 781 | |
| IMAGES-ALL-AT-ONCEBase Model=GPT-4O2025.02 | 10.18 | 15.8 | 0 | 8.15 | 7.65 | 2,902 | 252 | 764 | |
| OCRBase Model=GEMMA2025.02 | 10.75 | 3.11 | 2.63 | 0.1 | 0.39 | 0 | 1,367 | 781 | |
| OCR+PAGE1Base Model=GEMMA2025.02 | 10.89 | 3.2 | 2.63 | 0.15 | 0.42 | 871 | 1,244 | 847 | |
| OCR+PAGE1Base Model=GPT-4O2025.02 | 10.95 | 16.29 | 2.63 | 5.97 | 7.69 | 1,105 | 1,189 | 769 | |
| OCR+PAGENBase Model=GEMMA2025.02 | 11.02 | 3.34 | 2.63 | 0.25 | 0.47 | 871 | 1,269 | 851 | |
| OCRBase Model=Baseline2025.02 | 11.18 | 2.63 | 2.63 | 0 | 0 | 0 | 0 | 0 | |
| IMAGESBase Model=GEMMA2025.02 | 15.6 | 0.7 | 0 | 0.2 | 0.5 | 2,287 | 635 | 990 | |
| IMAGES-ALL-AT-ONCEBase Model=GEMMA2025.02 | 25.06 | 0.55 | 0 | 0.18 | 0.37 | 2,287 | 262 | 747 |