Handwriting Recognition on IAM (CER & Efficiency)
0.63CEROCR+PAGEN
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| OCR+PAGENModel=GEMINI2025.02 | 0.63 | 6.71 | 2.26 | 2.05 | 2.4 | 945 | 648 | 236 | |
| OCR+IMAGESModel=GEMINI2025.02 | 0.64 | 8.1 | 2.26 | 3.77 | 2.08 | 2,192 | 821 | 207 | |
| OCR+PAGE1Model=GEMINI2025.02 | 0.65 | 6.63 | 2.26 | 2 | 2.37 | 980 | 623 | 236 | |
| IMAGES-ALL-AT-ONCEModel=GEMINI2025.02 | 0.7 | 5.5 | 0 | 3.07 | 2.44 | 2,192 | 262 | 243 | |
| OCR+IMAGESModel=GPT-4o2025.02 | 0.72 | 12.69 | 2.26 | 8.29 | 2.13 | 2,519 | 797 | 213 | |
| OCR+PAGE1Model=GPT-4o2025.02 | 0.85 | 8.94 | 2.26 | 4.47 | 2.21 | 1,124 | 589 | 221 | |
| OCR+PAGENModel=GPT-4o2025.02 | 0.87 | 9.04 | 2.26 | 4.52 | 2.26 | 1,095 | 613 | 222 | |
| IMAGES-ALL-AT-ONCEModel=GPT-4o2025.02 | 0.92 | 9.29 | 0 | 7.11 | 2.18 | 2,515 | 252 | 218 | |
| IMAGESModel=GPT-4o2025.02 | 0.92 | 9.81 | 0 | 7.63 | 2.17 | 2,515 | 533 | 217 | |
| IMAGESModel=GEMINI2025.02 | 1.16 | 5.56 | 0 | 3.43 | 2.13 | 2,192 | 547 | 213 | |
| OCRModel=GPT-4o2025.02 | 1.21 | 6.17 | 2.26 | 1.77 | 2.14 | 26 | 682 | 213 | |
| OCR+PAGE1Model=GEMMA2025.02 | 1.36 | 2.5 | 2.26 | 0.11 | 0.12 | 980 | 623 | 243 | |
| OCRModel=GEMINI2025.02 | 1.57 | 5.21 | 2.26 | 0.87 | 2.08 | 0 | 699 | 207 | |
| OCR+IMAGESModel=GEMMA2025.02 | 1.78 | 2.58 | 2.26 | 0.21 | 0.11 | 2,192 | 821 | 216 | |
| IMAGES-ALL-AT-ONCEModel=GEMMA2025.02 | 1.97 | 0.29 | 0 | 0.17 | 0.12 | 2,192 | 262 | 242 | |
| OCR+PAGENModel=GEMMA2025.02 | 2.17 | 2.59 | 2.26 | 0.17 | 0.16 | 945 | 648 | 246 | |
| IMAGESModel=GEMMA2025.02 | 2.31 | 0.31 | 0 | 0.19 | 0.12 | 2,192 | 547 | 230 | |
| OCRModel=GEMMA2025.02 | 2.93 | 2.42 | 2.26 | 0.05 | 0.11 | 0 | 699 | 211 | |
| OCRModel=-2025.02 | 3.81 | 2.26 | 2.26 | 0 | 0 | 0 | 0 | 0 | |
| PYLAIAModel=PYLAIA, Configuration=Open-source baseline2025.02 | 6.51 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |