Handwriting Transcription on Bentham dataset
0.0848CEROCR+PAGEN
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| OCR+PAGENModel=GEMINI-2.5-PRO, Input=OCR+PAGEN2025.02 | 0.0848 | 13.56 | |
| OCR+PAGE1Model=GEMINI-2.5-PRO, Input=OCR+PAGE12025.02 | 0.0856 | 13.55 | |
| OCR+IMAGESModel=GEMINI-2.5-PRO, Input=OCR+IMAGES2025.02 | 0.0867 | 15.32 | |
| OCR+PAGENModel=GPT-4O, Input=OCR+PAGEN2025.02 | 0.0887 | 16.23 | |
| OCR+IMAGESModel=GPT-4O, Input=OCR+IMAGES2025.02 | 0.0935 | 20.93 | |
| OCRModel=GEMINI-2.5-PRO, Input=OCR2025.02 | 0.0954 | 12.03 | |
| IMAGESModel=GEMINI-2.5-PRO, Input=IMAGES2025.02 | 0.0974 | 11.64 | |
| IMAGESModel=GPT-4O, Input=IMAGES2025.02 | 0.0987 | 16.58 | |
| IMAGES-ALL-AT-ONCEModel=GEMINI-2.5-PRO, Input=IMAGES-ALL-AT-ONCE2025.02 | 0.0988 | 11.7 | |
| OCRModel=GPT-4O, Input=OCR2025.02 | 0.0997 | 13.63 | |
| OCR+IMAGESModel=GEMMA-3-27B, Input=OCR+IMAGES2025.02 | 0.0998 | 3.17 | |
| IMAGES-ALL-AT-ONCEModel=GPT-4O, Input=IMAGES-ALL-AT-ONCE2025.02 | 0.1018 | 15.85 | |
| OCRModel=GEMMA-3-27B, Input=OCR2025.02 | 0.1075 | 3.11 | |
| OCR+PAGE1Model=GEMMA-3-27B, Input=OCR+PAGE12025.02 | 0.1089 | 3.17 | |
| OCR+PAGE1Model=GPT-4O, Input=OCR+PAGE12025.02 | 0.1095 | 16.29 | |
| OCR+PAGENModel=GEMMA-3-27B, Input=OCR+PAGEN2025.02 | 0.1102 | 3.31 | |
| OCRModel=Azure Vision, Input=OCR2025.02 | 0.1118 | 2.63 | |
| IMAGESModel=GEMMA-3-27B, Input=IMAGES2025.02 | 0.1512 | 0.59 | |
| IMAGES-ALL-AT-ONCEModel=GEMMA-3-27B, Input=IMAGES-ALL-AT-ONCE2025.02 | 0.2788 | 0.5 |