Transcription on Malvern-Hills-10+ 1.0 (test)
4.76CEROCR+PAGE1
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| OCR+PAGE1Model=Gemini2025.02 | 4.76 | 61.13 | 11.5 | 7.23 | 42.41 | 0.77 | 5.01 | 4.24 | 40.6 | 0 | |
| OCR+IMAGESModel=Gemini2025.02 | 4.8 | 71.41 | 11.5 | 20.3 | 39.61 | 8.9 | 7.34 | 3.96 | 54.9 | 0 | |
| IMAGESModel=Gemini2025.02 | 4.87 | 54.71 | 0 | 14.61 | 40.11 | 8.9 | 2.78 | 4.01 | 60.6 | 0 | |
| OCR+PAGENModel=Gemini2025.02 | 5.41 | 61.77 | 11.5 | 7.62 | 42.65 | 0.77 | 5.03 | 4.26 | 63.8 | 0 | |
| OCR+PAGERModel=Gemini2025.02 | 5.5 | 61.82 | 11.5 | 7.26 | 43.06 | 0.77 | 5.03 | 4.31 | 40.1 | 0 | |
| IMAGES-AAOModel=Gemini2025.02 | 6.05 | 54.46 | 0 | 11.45 | 43 | 8.9 | 0.26 | 4.3 | 40.9 | 0 | |
| OCR+IMAGESModel=GPT-4o2025.02 | 6.44 | 87.86 | 11.5 | 40.11 | 36.26 | 8.93 | 7.12 | 3.63 | 165.4 | 0 | |
| OCRModel=Gemini2025.02 | 6.88 | 59.29 | 11.5 | 8.4 | 39.39 | 0 | 6.72 | 3.94 | 47.9 | 0 | |
| OCRModel=GPT-4o2025.02 | 8.48 | 67.28 | 11.5 | 16.65 | 39.13 | 0.13 | 6.53 | 3.91 | 93.2 | 0 | |
| IMAGESModel=GPT-4o2025.02 | 9.9 | 67.13 | 0 | 29.12 | 38.01 | 8.8 | 2.71 | 3.8 | 181.1 | 0 | |
| IMAGES-AAOModel=GPT-4o2025.02 | 11.64 | 59.37 | 0 | 23.45 | 35.92 | 8.8 | 0.25 | 3.59 | 100.8 | 0.2 | |
| OCRDescription=Baseline OCR output2025.02 | 12.92 | 11.5 | 11.5 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| OCR+PAGENModel=GPT-4o2025.02 | 16.37 | 57.09 | 11.5 | 12.58 | 33.01 | 0.77 | 4.7 | 3.3 | 123.7 | 0.3 | |
| OCR+PAGERModel=GPT-4o2025.02 | 17.11 | 56.93 | 11.5 | 12.22 | 33.21 | 0.77 | 4.7 | 3.32 | 103.9 | 0.3 | |
| OCR+PAGE1Model=GPT-4o2025.02 | 21.38 | 56.48 | 11.5 | 12.17 | 32.82 | 0.77 | 4.68 | 3.28 | 119.1 | 0.4 |