Handwritten Mathematical Expression Recognition on CROHME 2019 (test)
79.23Expression Rate (Exp)Uni-MuMER
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Uni-MuMERexternal data=true2025.05 | 79.23 | 82.4 | — | — | — | — | |
| Uni-MuMERzero-shot inference=true, external data used=true2025.05 | 79.23 | — | 90.91 | 93.83 | — | — | |
| Uni-MuMER2025.05 | 73.73 | 77.23 | — | — | — | — | |
| Uni-MuMERzero-shot inference=true2025.05 | 73.73 | — | 86.74 | 91.83 | — | — | |
| HiE-VLexternal data=true2025.05 | 69.3 | — | — | — | — | — | |
| HiE-VLMzero-shot inference=true, external data used=true2025.05 | 69.3 | — | 81.9 | 86.2 | — | — | |
| Vanilla (baseline)reproduced=true2025.05 | 69.14 | 71.98 | — | — | — | — | |
| Vanilla (baseline)zero-shot inference=true2025.05 | 69.06 | — | 82.07 | 88.07 | — | — | |
| UniMERNetdata augmentation=true, external data=true2025.05 | 65.4 | — | — | — | — | — | |
| SSANdata augmentation=true, reproduced=true2025.05 | 65.3 | — | — | — | — | — | |
| SSANzero-shot inference=true, data augmentation=true2025.05 | 65.3 | — | — | — | — | — | |
| PosFormerdata augmentation=true, reproduced=true2025.05 | 64.97 | 69.3 | — | — | — | — | |
| PosFormerzero-shot inference=true, data augmentation=true2025.05 | 64.97 | — | 82.49 | 87.24 | — | — | |
| PosFormerScale-aug=true2024.07 | 64.97 | — | 82.49 | 87.24 | — | 90.16 | |
| CAN-ABMData augmentation=true2022.07 | 64.47 | — | 78.73 | 82.99 | — | — | |
| CAN-DWAPData augmentation=true2022.07 | 63.22 | — | 78.07 | 82.49 | — | — | |
| COMERreproduced=true2025.05 | 62.97 | — | — | — | — | — | |
| COMERzero-shot inference=true, reproduced=true2025.05 | 62.97 | — | 77.4 | 81.4 | — | — | |
| CoMER2022.07 | 62.97 | — | 77.4 | 81.4 | — | 83.07 | |
| COMERScale-aug=true2024.07 | 62.97 | — | 77.4 | 81.4 | — | 83.07 | |
| VLPGexternal data=true2025.05 | 62.34 | — | — | — | — | — | |
| VLPGzero-shot inference=true, external data used=true2025.05 | 62.34 | — | 76.81 | 81.15 | — | — | |
| PosFormer2025.05 | 62.22 | — | — | — | — | — | |
| PosFormerzero-shot inference=true2025.05 | 62.22 | — | 79.4 | 86.57 | — | — | |
| ABM (baseline)Data augmentation=true, Reproduced=true2022.07 | 62.22 | — | 77.23 | 81.9 | — | — | |
| PosFormerScale-aug=false2024.07 | 62.22 | — | 79.4 | 86.57 | — | 89.99 | |
| TAMERzero-shot inference=true2025.05 | 61.97 | — | 78.97 | 85.8 | — | — | |
| TAMERdata augmentation=none2024.08 | 61.97 | — | 78.97 | 85.8 | — | — | |
| SSAN2025.05 | 61.83 | — | — | — | — | — | |
| SSANzero-shot inference=true2025.05 | 61.83 | — | 79.08 | 86.08 | — | — | |
| NAMERdata augmentation=none2024.08 | 61.72 | — | 75.31 | 82.07 | — | — | |
| GCNsupplementary_information=true2024.05 | 61.63 | — | — | — | — | — | |
| GCNdata augmentation=none2024.08 | 61.63 | — | — | — | — | — | |
| BPD-CoverageScale-aug=true2024.07 | 61.47 | — | — | — | — | — | |
| Ding et al.2022.07 | 61.38 | — | 75.15 | 80.23 | — | 82.65 | |
| Ding et al.Data augmentation=true2022.07 | 61.38 | — | 75.15 | 80.23 | — | — | |
| Ding et al.Scale-aug=false2024.07 | 61.38 | — | 75.15 | 80.23 | — | 82.65 | |
| ICAL2025.05 | 60.51 | — | — | — | — | — | |
| ICAL2024.05 | 60.51 | — | 78 | 84.63 | — | — | |
| ICALdata augmentation=none2024.08 | 60.51 | — | 78 | 84.63 | — | — | |
| TAMER2025.05 | 60.13 | 63.46 | — | — | — | — | |
| BTTRvariant=baseline2022.07 | 59.55 | — | 72.23 | 76.06 | — | 78.4 | |
| COMER2025.05 | 59.12 | 62.71 | — | — | — | — | |
| COMERzero-shot inference=true2025.05 | 59.12 | — | 77.45 | 83.87 | — | — | |
| CoMERreproduced=true2024.05 | 59.12 | — | 77.45 | 83.87 | — | — | |
| CoMERdata augmentation=none, reproduced=true2024.08 | 59.12 | — | 77.45 | 83.87 | — | — | |
| TDv22024.05 | 58.72 | — | — | — | — | — | |
| TDv2data augmentation=none2024.08 | 58.72 | — | — | — | — | — | |
| TSDNetScale-aug=false2024.07 | 56.34 | — | 72.97 | 77.84 | — | — | |
| DWAP (baseline)Data augmentation=true, Reproduced=true2022.07 | 56.05 | — | 72.23 | 79.15 | — | — | |
| CAN-ABM2025.05 | 55.96 | — | — | — | — | — | |
| CAN-ABMzero-shot inference=true2025.05 | 55.96 | — | 72.73 | 80.57 | — | — | |
| CAN-ABMData augmentation=false2022.07 | 55.96 | — | 72.73 | 80.57 | — | — | |
| CANScale-aug=false2024.07 | 55.96 | — | 72.73 | 80.57 | — | — | |
| CAN-ABM2024.05 | 55.96 | — | 72.73 | 80.57 | — | — | |
| CAN-ABMdata augmentation=none2024.08 | 55.96 | — | 72.73 | 80.57 | — | — | |
| Gemini2.5-flashzero-shot=true2025.05 | 55.21 | 65.38 | — | — | — | — | |
| Gemini 1.5-flashzero-shot inference=true2025.05 | 55.21 | — | 70.14 | 79.48 | — | — | |
| Qwen2.5-VL-72Bzero-shot=true2025.05 | 55.13 | 61.05 | — | — | — | — | |
| Qwen2.5-VL-72Bzero-shot inference=true2025.05 | 55.13 | — | 69.81 | 78.65 | — | — | |
| CAN-DWAPData augmentation=false2022.07 | 54.88 | — | 71.98 | 79.4 | — | — | |
| CAN-DWAP2024.05 | 54.88 | — | 71.98 | 79.4 | — | — | |
| CAN-DWAPdata augmentation=none2024.08 | 54.88 | — | 71.98 | 79.4 | — | — | |
| ABM2025.05 | 53.96 | — | — | — | — | — | |
| ABMzero-shot inference=true2025.05 | 53.96 | — | 71.06 | 78.65 | — | — | |
| ABM2021.12 | 53.96 | — | 71.06 | 78.65 | — | — | |
| ABMData augmentation=false2022.07 | 53.96 | — | 71.06 | 78.65 | — | — | |
| ABM2024.05 | 53.96 | — | 71.06 | 78.65 | — | — | |
| ABMdata augmentation=none2024.08 | 53.96 | — | 71.06 | 78.65 | — | — | |
| ABM (baseline)Data augmentation=false, Reproduced=true2022.07 | 53.71 | — | 71.23 | 78.23 | — | — | |
| SANScale-aug=false2024.07 | 53.5 | — | 69.3 | 70.1 | — | — | |
| SAN2024.05 | 53.5 | — | 69.3 | 70.1 | — | — | |
| SANdata augmentation=none2024.08 | 53.5 | — | 69.3 | 70.1 | — | — | |
| BTTR2025.05 | 52.96 | — | — | — | — | — | |
| BTTRzero-shot inference=true2025.05 | 52.96 | — | 65.97 | 69.14 | — | — | |
| BTTRDirection=Bidirectional2021.05 | 52.96 | — | 65.97 | 69.14 | 70.06 | — | |
| BTTRmodel=bidirectionally trained transformer2021.12 | 52.96 | — | 65.97 | 69.14 | — | — | |
| BTTR2022.07 | 52.96 | — | 65.97 | 69.14 | — | — | |
| BTTRData augmentation=false2022.07 | 52.96 | — | 65.97 | 69.14 | — | — | |
| BTTRScale-aug=false2024.07 | 52.96 | — | 65.97 | 69.14 | — | — | |
| BTTR2024.05 | 52.96 | — | 65.97 | 69.14 | — | — | |
| BTTRdata augmentation=none2024.08 | 52.96 | — | 65.97 | 69.14 | — | — | |
| DenseWAP-TD2021.05 | 51.4 | — | 66.1 | 69.1 | 69.8 | — | |
| DWAP-TDdecoder=tree decoder2021.12 | 51.4 | — | 66.1 | 69.1 | — | — | |
| DenseWAP-TD2022.07 | 51.4 | — | 66.1 | 69.1 | — | — | |
| DWAP-TDData augmentation=false2022.07 | 51.4 | — | 66.1 | 69.1 | — | — | |
| Dense WAP-TD2024.05 | 51.4 | — | 66.1 | 69.1 | — | — | |
| DenseWAP-TDdata augmentation=none2024.08 | 51.4 | — | 66.1 | 69.1 | — | — | |
| DWAP (baseline)Data augmentation=false, Reproduced=true2022.07 | 50.04 | — | 65.39 | 69.39 | — | — | |
| GPT-4ozero-shot=true2025.05 | 49.79 | 57.13 | — | — | — | — | |
| GPT-4ozero-shot inference=true2025.05 | 49.79 | — | 64.79 | 75.06 | — | — | |
| Qwen2.5-VL-7Bzero-shot=true2025.05 | 49.62 | 56.55 | — | — | — | — | |
| Qwen2.5-VL-7Bzero-shot inference=true2025.05 | 49.62 | — | 67.22 | 76.73 | — | — | |
| COMERzero-shot inference=true, data augmentation=true2025.05 | 48.29 | — | 64.22 | 71.64 | — | — | |
| CoMERdata augmentation=true, reproduced=true2025.05 | 48.25 | 54.84 | — | — | — | — | |
| DWAPbackbone=DenseNet2021.12 | 47.7 | — | 59.5 | 63.3 | — | — | |
| DWAP-MSAData augmentation=false2022.07 | 47.7 | — | 59.5 | 63.3 | — | — | |
| Dense WAP-MSA2024.05 | 47.7 | — | 59.5 | 63.3 | — | — | |
| DenseWAP-MSAdata augmentation=none2024.08 | 47.7 | — | 59.5 | 63.3 | — | — | |
| Doubao-1.5-prozero-shot=true2025.05 | 46.87 | 64.05 | — | — | — | — |