Handwritten Text Recognition on RIMES
2.13Character Error Rate (CER)MetaWriter
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MetaWriterArchitecture=CNN-Transf. + MAE, Param. updates=Yes, Test-time adaptation=Yes, Evaluation Level=Line-level2026.03 | 2.13 | 6.55 | — | — | |
| DocTTTArchitecture=CNN-Transf. + MAE, Param. updates=Yes, Test-time adaptation=Yes, Evaluation Level=Line-level2026.03 | 2.33 | 6.47 | — | — | |
| OursArchitecture=CNN-Transf., Param. updates=No, Test-time adaptation=Yes, Evaluation Level=Line-level2026.03 | 2.34 | 8.01 | — | — | |
| DANArchitecture=CNN-Transf., Param. updates=No, Test-time adaptation=No, Evaluation Level=Line-level2026.03 | 2.63 | 6.78 | — | — | |
| Decoupled ANArchitecture=CNN-RNN + Attn, Param. updates=No, Test-time adaptation=No, Evaluation Level=Line-level2026.03 | 2.7 | 8.9 | — | — | |
| Retsinas et al.Architecture=CNN-BiLSTM, Param. updates=No, Test-time adaptation=No, Evaluation Level=Line-level2026.03 | 2.75 | 9.93 | — | — | |
| VLTArchitecture=CNN-Transf., Param. updates=No, Test-time adaptation=No, Evaluation Level=Line-level2026.03 | 2.82 | 8.47 | — | — | |
| Ours (baseline)Architecture=CNN-Transf., Param. updates=No, Test-time adaptation=No, Evaluation Level=Line-level2026.03 | 2.91 | 8.67 | — | — | |
| VANArchitecture=CNN-LSTM + Attn, Param. updates=No, Test-time adaptation=No, Evaluation Level=Line-level2026.03 | 3.04 | 8.32 | — | — | |
| SPANArchitecture=FCN, Param. updates=No, Test-time adaptation=No, Evaluation Level=Line-level2026.03 | 3.81 | 13.8 | — | — | |
| DAN2025.04 | 4.54 | — | — | — | |
| PILOT2025.04 | 5.05 | — | 75.77 | 91.75 | |
| GPT-4oEvaluation protocol=Reproduced2025.04 | 5.13 | — | 66.15 | 86.39 | |
| DANIEL2025.04 | 5.8 | — | — | — | |
| Qwen2.5-VL-7BEvaluation protocol=Reproduced2025.04 | 6.66 | — | 69.41 | 85.67 | |
| OlmOCR-2-7BEvaluation protocol=Reproduced2025.04 | 8.2 | — | 22.43 | 85.01 | |
| GPT-4o-miniEvaluation protocol=Reproduced2025.04 | 8.88 | — | 45.62 | 83.38 | |
| Qwen3-VL-4BEvaluation protocol=Reproduced2025.04 | 12.33 | — | 64.32 | 80.84 | |
| Nanonets-OCR2-3BEvaluation protocol=Reproduced2025.04 | 14.5 | — | 63.41 | 88.68 | |
| PaddleOCR-VLEvaluation protocol=Reproduced2025.04 | 14.85 | — | 27.09 | 67.49 | |
| Nanonets-OCR-sEvaluation protocol=Reproduced2025.04 | 15.15 | — | 47.01 | 83.74 | |
| Claude-3-HaikuEvaluation protocol=Reproduced2025.04 | 18.62 | — | 26.68 | 67.59 | |
| InternVL2.5-8BEvaluation protocol=Reproduced2025.04 | 35.1 | — | 18.77 | 46.26 | |
| Phi-3.5-VisionEvaluation protocol=Reproduced2025.04 | 36.91 | — | 19.71 | 33.81 | |
| EasyOCREvaluation protocol=Reproduced2025.04 | 62.06 | — | 0.05 | 8.61 | |
| TesseractEvaluation protocol=Reproduced2025.04 | 73.95 | — | 1.26 | 8.14 |